Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

API monitoring integration tests failing for cloud #29966

Closed
liza-mae opened this issue Feb 4, 2019 · 5 comments
Closed

API monitoring integration tests failing for cloud #29966

liza-mae opened this issue Feb 4, 2019 · 5 comments
Assignees
@chrisronline
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Monitoring Stack Monitoring team test test-api-integration test-cloud

Comments

@liza-mae
Copy link
Contributor

liza-mae commented Feb 4, 2019

Hi I have the following test failures running on cloud. Version: 6.7.0, needs investigating if tests are applicable on cloud, real failures or needs tests changes.

fail: "apis Monitoring cluster overview with trial license clusters should load multiple clusters"
fail: "apis Monitoring Elasticsearch node detail should summarize node with metrics"
fail: "apis Monitoring elasticsearch_settings check nodes settings should check node settings"
@liza-mae liza-mae added test Team:Monitoring Stack Monitoring team failed-test A test failure on a tracked branch, potentially flaky-test test-cloud test-api-integration labels Feb 4, 2019
@elasticmachine
Copy link
Contributor

Pinging @elastic/stack-monitoring

@liza-mae
Copy link
Contributor Author

liza-mae commented Feb 4, 2019 

         └- ✖ fail: "apis Monitoring cluster overview with trial license clusters should load multiple clusters"
         │ 
         │       Error: expected [ { cluster_uuid: 'y1qOsQPiRrGtmdEuM3APJw',
         │     cluster_name: 'singlecluster',
         │     version: '7.0.0-alpha1',
         │     license: 
         │      { status: 'active',
         │        type: 'gold',
         │        expiry_date_in_millis: 1914278399999 },
         │     elasticsearch: { cluster_stats: [Object] },
         │     logstash: 
         │      { node_count: 1,
         │        events_in_total: 31,
         │        events_out_total: 31,
         │        avg_memory: 1038876672,
         │        avg_memory_used: 479515336,
         │        max_uptime: 603966,
         │        pipeline_count: 1,
         │        queue_types: [Object],
         │        versions: [Object] },
         │     kibana: 
         │      { status: 'green',
         │        requests_total: 914,
         │        concurrent_connections: 646,
         │        response_time_max: 2873,
         │        memory_size: 196005888,
         │        memory_limit: 1501560832,
         │        count: 1 },
         │     beats: { totalEvents: null, bytesSent: null, beats: [Object] },
         │     apm: 
         │      { totalEvents: null,
         │        memRss: null,
         │        memTotal: null,
         │        apms: [Object] },
         │     alerts: [ [Object] ],
         │     isPrimary: false,
         │     status: 'green' } ] to sort of equal [ { cluster_uuid: 'y1qOsQPiRrGtmdEuM3APJw',
         │     cluster_name: 'singlecluster',
         │     version: '7.0.0-alpha1',
         │     license: 
         │      { status: 'active',
         │        type: 'gold',
         │        expiry_date_in_millis: 1914278399999 },
         │     elasticsearch: { cluster_stats: [Object] },
         │     logstash: 
         │      { node_count: 1,
         │        events_in_total: 31,
         │        events_out_total: 31,
         │        avg_memory: 1038876672,
         │        avg_memory_used: 479515336,
         │        max_uptime: 603966,
         │        pipeline_count: 1,
         │        queue_types: [Object],
         │        versions: [Object] },
         │     kibana: 
         │      { status: 'green',
         │        requests_total: 914,
         │        concurrent_connections: 646,
         │        response_time_max: 2873,
         │        memory_size: 196005888,
         │        memory_limit: 1501560832,
         │        count: 1 },
         │     apm: 
         │      { totalEvents: null,
         │        memRss: null,
         │        memTotal: null,
         │        apms: [Object] },
         │     beats: { totalEvents: null, bytesSent: null, beats: [Object] },
         │     alerts: [ [Object] ],
         │     isPrimary: true,
         │     status: 'green' } ]
         │       + expected - actual
         │ 
         │                }
         │                "status": "green"
         │              }
         │            }
         │       -    "isPrimary": false
         │       +    "isPrimary": true
         │            "kibana": {
         │              "concurrent_connections": 646
         │              "count": 1
         │              "memory_limit": 1501560832
         │       
         │       at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
         │       at Assertion.eql (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:230:10)
         │       at Context.it (test/api_integration/apis/monitoring/cluster/overview.js:36:25)

@liza-mae
Copy link
Contributor Author

liza-mae commented Feb 4, 2019 

       └- ✖ fail: "apis Monitoring Elasticsearch node detail should summarize node with metrics"
       │ 
       │       Error: expected { nodeSummary: 
       │    { resolver: 'jxcP6ue7eRCieNNitFTT0EA',
       │      node_ids: [],
       │      attributes: {},
       │      transport_address: '',
       │      name: 'jxcP6ue7eRCieNNitFTT0EA',
       │      type: 'node',
       │      nodeTypeLabel: 'Offline Node',
       │      status: 'Offline',
       │      isOnline: false },
       │   metrics: 
       │    { node_latency: [ [Object], [Object] ],
       │      node_jvm_mem: [ [Object], [Object] ],
       │      node_mem: [ [Object], [Object], [Object] ],
       │      node_cpu_metric: [ [Object] ],
       │      node_load_average: [ [Object] ],
       │      node_segment_count: [ [Object] ] },
       │   shards: [],
       │   shardStats: 
       │    { indices: 
       │       { 'avocado-tweets-2017.09.30': [Object],
       │         'avocado-tweets-2017.10.02': [Object],
       │         'avocado-tweets-2017.10.03': [Object],
       │         'phone-home': [Object],
       │         'watermelon-tweets-2017.10.05': [Object],
       │         '.security-v6': [Object],
       │         '.kibana': [Object],
       │         '.monitoring-alerts-6': [Object],
       │         '.monitoring-es-6-2017.10.05': [Object],
       │         '.monitoring-kibana-6-2017.10.05': [Object],
       │         '.triggered_watches': [Object],
       │         '.watcher-history-7-2017.09.29': [Object],
       │         '.watcher-history-7-2017.09.30': [Object],
       │         '.watcher-history-7-2017.10.01': [Object],
       │         '.watcher-history-7-2017.10.02': [Object],
       │         '.watcher-history-7-2017.10.03': [Object],
       │         '.watcher-history-7-2017.10.04': [Object],
       │         '.watcher-history-7-2017.10.05': [Object],
       │         '.watches': [Object],
       │         relocation_test: [Object] } },
       │   nodes: 
       │    { jUT5KdxfRbORSCWkb5zjmA: 
       │       { shardCount: 38,
       │         indexCount: 20,
       │         name: 'whatever-01',
       │         node_ids: [Object],
       │         type: 'master' },
       │      xcP6ue7eRCieNNitFTT0EA: 
       │       { shardCount: 36,
       │         indexCount: 19,
       │         name: 'whatever-02',
       │         node_ids: [Object],
       │         type: 'node' },
       │      'bwQWH-7IQY-mFPpfoaoFXQ': 
       │       { shardCount: 4,
       │         indexCount: 4,
       │         name: 'whatever-03',
       │         node_ids: [Object],
       │         type: 'node' } },
       │   stateUuid: '6wwwErXyTfaa4uHBHG5Pbg' } to sort of equal { nodeSummary: 
       │    { resolver: 'jxcP6ue7eRCieNNitFTT0EA',
       │      node_ids: [],
       │      attributes: {},
       │      transport_address: '',
       │      name: 'jxcP6ue7eRCieNNitFTT0EA',
       │      type: 'node',
       │      nodeTypeLabel: 'Offline Node',
       │      status: 'Offline',
       │      isOnline: false },
       │   metrics: 
       │    { node_latency: [ [Object], [Object] ],
       │      node_jvm_mem: [ [Object], [Object] ],
       │      node_mem: [ [Object], [Object], [Object] ],
       │      node_cpu_metric: [ [Object] ],
       │      node_load_average: [ [Object] ],
       │      node_segment_count: [ [Object] ] },
       │   shards: [],
       │   shardStats: 
       │    { indices: 
       │       { 'avocado-tweets-2017.09.30': [Object],
       │         'avocado-tweets-2017.10.02': [Object],
       │         'avocado-tweets-2017.10.03': [Object],
       │         'phone-home': [Object],
       │         'watermelon-tweets-2017.10.05': [Object],
       │         '.security-v6': [Object],
       │         '.kibana': [Object],
       │         '.monitoring-alerts-6': [Object],
       │         '.monitoring-es-6-2017.10.05': [Object],
       │         '.monitoring-kibana-6-2017.10.05': [Object],
       │         '.triggered_watches': [Object],
       │         '.watcher-history-7-2017.09.29': [Object],
       │         '.watcher-history-7-2017.09.30': [Object],
       │         '.watcher-history-7-2017.10.01': [Object],
       │         '.watcher-history-7-2017.10.02': [Object],
       │         '.watcher-history-7-2017.10.03': [Object],
       │         '.watcher-history-7-2017.10.04': [Object],
       │         '.watcher-history-7-2017.10.05': [Object],
       │         '.watches': [Object],
       │         relocation_test: [Object] } },
       │   nodes: 
       │    { jUT5KdxfRbORSCWkb5zjmA: 
       │       { shardCount: 38,
       │         indexCount: 20,
       │         name: 'whatever-01',
       │         node_ids: [Object],
       │         type: 'master' },
       │      xcP6ue7eRCieNNitFTT0EA: 
       │       { shardCount: 36,
       │         indexCount: 19,
       │         name: 'whatever-02',
       │         node_ids: [Object],
       │         type: 'node' },
       │      'bwQWH-7IQY-mFPpfoaoFXQ': 
       │       { shardCount: 4,
       │         indexCount: 4,
       │         name: 'whatever-03',
       │         node_ids: [Object],
       │         type: 'node' } },
       │   stateUuid: '6wwwErXyTfaa4uHBHG5Pbg' }
       │       + expected - actual
       │ 
       │                "bucket_size": "10 seconds"
       │                "data": []
       │                "metric": {
       │                  "app": "elasticsearch"
       │       -          "description": "CPU Usage time compared to the CPU quota shown in percentage. If CPU quotas are not set, then no data will be shown."
       │       +          "description": "Percentage of CPU usage for the Elasticsearch process."
       │                  "field": "node_stats.process.cpu.percent"
       │                  "format": "0,0.[00]"
       │       -          "hasCalculation": true
       │       -          "isDerivative": true
       │       +          "hasCalculation": false
       │       +          "isDerivative": false
       │                  "label": "CPU Utilization"
       │                  "metricAgg": "max"
       │                  "units": "%"
       │                }
       │       
       │       at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
       │       at Assertion.eql (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:230:10)
       │       at Context.it (test/api_integration/apis/monitoring/elasticsearch/node_detail.js:40:23)

@liza-mae
Copy link
Contributor Author

liza-mae commented Feb 4, 2019 

       └- ✖ fail: "apis Monitoring elasticsearch_settings check nodes settings should check node settings"
       │      Error: expected true to equal false
       │       at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
       │       at Assertion.be.Assertion.equal (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:216:10)
       │       at Assertion.(anonymous function) [as be] (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:69:24)
       │       at Context.it (test/api_integration/apis/monitoring/elasticsearch_settings/check_nodes.js:18:29)
       │ 
       │

@chrisronline chrisronline self-assigned this Feb 4, 2019
This was referenced Feb 5, 2019
Closed
Closed
Closed
Closed
@chrisronline
Copy link
Contributor

We're skipping the tests for now. Track progress on re-adding here: https://github.com/elastic/stack-monitoring/issues/31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@chrisronline chrisronline

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Monitoring Stack Monitoring team test test-api-integration test-cloud
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@chrisronline @elasticmachine @liza-mae