[7.x] [ML] DF Analytics creation: ensure job did not fail to start before showing results link (#78200) #78664

alvarezmelissa87 · 2020-09-28T18:38:36Z

Backports the following commits to 7.x:

[ML] DF Analytics creation: ensure job did not fail to start before showing results link ([ML] DF Analytics creation: ensure job did not fail to start before showing results link #78200)

…howing results link (elastic#78200) * ensure job did not fail to start before showing results link * simplify job started check * update job finished check

elasticmachine · 2020-09-28T19:11:28Z

Pinging @elastic/ml-ui (:ml)

kibanamachine · 2020-09-28T20:44:56Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 1714959
Flaky suites:
- xpack-kibana-ciGroup2

Test Failures

X-Pack Reporting API Integration Tests.x-pack/test/reporting_api_integration/reporting_and_security/spaces·ts.Reporting APIs Exports and Spaces CSV saved search export should use formats from non-default spaces

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://github.com/elastic/kibana/issues/77972

[00:00:00]       │
[00:00:00]         └-: Reporting APIs
[00:00:00]           └-> "before all" hook
[00:02:05]           └-: Exports and Spaces
[00:02:05]             └-> "before all" hook
[00:02:05]             └-> "before all" hook
[00:02:05]               │ info [reporting/ecommerce] Loading "mappings.json"
[00:02:05]               │ info [reporting/ecommerce] Loading "data.json.gz"
[00:02:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [ecommerce] creating index, cause [api], templates [], shards [1]/[0]
[00:02:05]               │ info [reporting/ecommerce] Created index "ecommerce"
[00:02:05]               │ debg [reporting/ecommerce] "ecommerce" settings {"index":{"number_of_replicas":"0","number_of_shards":"1"}}
[00:02:05]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/ke4Hqo8xR7iPDXNck3bKxg] deleting index
[00:02:05]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1/MyPCobPnRyWW3up-vxy9Iw] deleting index
[00:02:05]               │ info [reporting/ecommerce] Deleted existing index [".kibana_2",".kibana_1"]
[00:02:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1] creating index, cause [api], templates [], shards [1]/[0]
[00:02:05]               │ info [reporting/ecommerce] Created index ".kibana_1"
[00:02:05]               │ debg [reporting/ecommerce] ".kibana_1" settings {"index":{"auto_expand_replicas":"0-1","number_of_replicas":"0","number_of_shards":"1"}}
[00:02:07]               │ info [reporting/ecommerce] Indexed 4675 docs into "ecommerce"
[00:02:07]               │ info [reporting/ecommerce] Indexed 3 docs into ".kibana_1"
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1/moQMIIi1TEKhWm98V2dn4w] update_mapping [_doc]
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1/moQMIIi1TEKhWm98V2dn4w] update_mapping [_doc]
[00:02:07]               │ debg Migrating saved objects
[00:02:07]               │ proc [kibana]   log   [19:55:26.113] [info][savedobjects-service] Creating index .kibana_2.
[00:02:07]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:02:07]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] updating number_of_replicas to [0] for indices [.kibana_2]
[00:02:07]               │ proc [kibana]   log   [19:55:26.174] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/ivI0gtYGSnudbGeDGMeceA] update_mapping [_doc]
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/ivI0gtYGSnudbGeDGMeceA] update_mapping [_doc]
[00:02:07]               │ proc [kibana]   log   [19:55:26.267] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:02:07]               │ proc [kibana]   log   [19:55:26.314] [info][savedobjects-service] Finished in 203ms.
[00:02:07]               │ info [reporting/ecommerce_kibana_spaces] Loading "mappings.json"
[00:02:07]               │ info [reporting/ecommerce_kibana_spaces] Loading "data.json.gz"
[00:02:07]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/ivI0gtYGSnudbGeDGMeceA] deleting index
[00:02:07]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1/moQMIIi1TEKhWm98V2dn4w] deleting index
[00:02:07]               │ info [reporting/ecommerce_kibana_spaces] Deleted existing index [".kibana_2",".kibana_1"]
[00:02:07]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1] creating index, cause [api], templates [], shards [1]/[0]
[00:02:07]               │ info [r.suppressed] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] path: /.kibana/_doc/config%3A7.10.0-SNAPSHOT, params: {index=.kibana, id=config:7.10.0-SNAPSHOT}
[00:02:07]               │      org.elasticsearch.action.NoShardAvailableActionException: No shard available for [get [.kibana][_doc][config:7.10.0-SNAPSHOT]: routing [null]]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.perform(TransportSingleShardAction.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.onFailure(TransportSingleShardAction.java:210) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.access$1100(TransportSingleShardAction.java:136) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction$2.handleException(TransportSingleShardAction.java:266) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1181) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1290) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService$DirectResponseChannel.sendResponse(TransportService.java:1264) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TaskTransportChannel.sendResponse(TaskTransportChannel.java:61) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.onFailure(SecurityServerTransportInterceptor.java:248) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:39) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:365) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:76) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:65) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:65) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:106) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:86) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:366) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:343) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:285) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:641) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:555) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:335) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:678) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:579) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:273) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:678) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:366) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:269) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:676) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10
[00:02:07]               │ info .0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:272) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:676) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$5(RBACEngine.java:327) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:351) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:324) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:283) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:248) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:212) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:126) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:159) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:276) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:132) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:120) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:214) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:129) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:323) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:384) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:395) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:320) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:261) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:173) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:120) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService.sendLocalRequest(TransportService.java:803) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService.access$100(TransportService.java:76) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService$3.sendRequest(TransportService.java:130) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService.sendRequestInternal(TransportService.java:747) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor.sendWithUser(SecurityServerTransportInterceptor.java:162) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor.access$300(SecurityServerTransportInterceptor.java:53) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$1.sendRequest(SecurityServerTransportInterceptor.java:129) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:661) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:593) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.perform(TransportSingleShardAction.java:246) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.start(TransportSingleShardAction.java:201) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction.doExecute(TransportSingleShardAction.java:103) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction.doExecute(TransportSingleShardAction.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:179) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ActionFilter$Simple.apply(ActionFilter.java:53) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:177) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.lambda$apply$0(SecurityActionFilter.java:87) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.lambda$authorizeRequest$4(SecurityActionFilter.java:173) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:365) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:76) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:65) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:65) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:106) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:360) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:86) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:366) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:343) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:285) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:641) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:555) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:335) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:678) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:579) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:273) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:678) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:366) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:269) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:676) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:272) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:676) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$5(RBACEngine.java:327) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:351) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:324) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:283) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:248) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:212) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:126) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:159) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:276) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:132) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:120) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:214) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.authorizeRequest(SecurityActionFilter.java:173) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.lambda$applyInternal$3(SecurityActionFilter.java:159) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:323) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:384) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:395) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:320) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:261) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:156) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.applyInternal(SecurityActionFilter.java:156) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:108) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:177) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:155) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:83) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:86) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:75) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:409) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.client.support.AbstractClient.get(AbstractClient.java:507) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.rest.action.document.RestGetAction.lambda$prepareRequest$0(RestGetAction.java:96) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:115) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.rest.SecurityRestFilter.lambda$handleRequest$0(SecurityRestFilter.java:76) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.SecondaryAuthenticator.lambda$authenticateAndAttachToContext$2(SecondaryAuthenticator.java:82) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.SecondaryAuthenticator.authenticate(SecondaryAuthenticator.java:92) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.SecondaryAuthenticator.authenticateAndAttachToContext(SecondaryAuthenticator.java:77) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.rest.SecurityRestFilter.lambda$handleRequest$2(SecurityRestFilter.java:70) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$writeAuthToContext$24(AuthenticationService.java:687) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.writeAuthToContext(AuthenticationService.java:702) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.finishAuthentication(AuthenticationService.java:676) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.consumeUser(AuthenticationService.java:623) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$consumeToken$16(AuthenticationService.java:493) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:120) [x-pack-core-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$consumeToken$13(AuthenticationService.java:459) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.lambda$authenticateWithCache$1(CachingUsernamePasswordRealm.java:146) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.handleCachedAuthentication(CachingUsernamePasswordRealm.java:197) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.lambda$authenticateWithCache$2(CachingUsernamePasswordRealm.java:138) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:224) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.ListenableFuture.addListener(ListenableFuture.java:68) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticateWithCache(CachingUsernamePasswordRealm.java:133) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.support.CachingUsernamePasswordRealm.authenticate(CachingUsernamePasswordRealm.java:104) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$consumeToken$15(AuthenticationService.java:448) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.core.common.IteratingActionListener.run(IteratingActionListener.java:102) [x-pack-core-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.consumeToken(AuthenticationService.java:503) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$extractToken$11(AuthenticationService.java:415) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.extractToken(AuthenticationService.java:425) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$checkForApiKey$3(AuthenticationService.java:366) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.ApiKeyService.authenticateWithApiKeyIfPresent(ApiKeyService.java:342) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.checkForApiKey(AuthenticationService.java:347) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$0(AuthenticationService.java:329) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.TokenService.getAndValidateToken(TokenService.java:405) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:325) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:384) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:395) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:320) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:261) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:141) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:126) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:63) [x-pack-security-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:249) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:331) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:189) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:319) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:384) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:309) [elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:42) [transport-netty4-client-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:28) [transport-netty4-client-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:58) [transport-netty4-client-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
[00:02:07]               │      	at java.lang.Thread.run(Thread.java:832) [?:?]
[00:02:07]               │      Caused by: org.elasticsearch.transport.RemoteTransportException: [kibana-ci-immutable-centos-tests-xxl-1601318359848355586][127.0.0.1:6143][indices:data/read/get[s]]
[00:02:07]               │      Caused by: org.elasticsearch.index.IndexNotFoundException: no such index [.kibana_2]
[00:02:07]               │      	at org.elasticsearch.indices.IndicesService.indexServiceSafe(IndicesService.java:513) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.get.TransportGetAction.asyncShardOperation(TransportGetAction.java:82) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.get.TransportGetAction.asyncShardOperation(TransportGetAction.java:45) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$ShardTransportHandler.messageReceived(TransportSingleShardAction.java:289) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$ShardTransportHandler.messageReceived(TransportSingleShardAction.java:282) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257) ~[?:?]
[00:02:07]               │      	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.10.0-SNAPSHOT.jar:7.10.0-SNAPSHOT]
[00:02:07]               │      	... 376 more
[00:02:07]               │ proc [kibana]   log   [19:55:26.418] [error][data][elasticsearch] [no_shard_available_action_exception]: No shard available for [get [.kibana][_doc][config:7.10.0-SNAPSHOT]: routing [null]]
[00:02:07]               │ info [reporting/ecommerce_kibana_spaces] Created index ".kibana_1"
[00:02:07]               │ debg [reporting/ecommerce_kibana_spaces] ".kibana_1" settings {"index":{"auto_expand_replicas":"0-1","number_of_replicas":"0","number_of_shards":"1"}}
[00:02:07]               │ info [reporting/ecommerce_kibana_spaces] Indexed 13 docs into ".kibana_1"
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_1/PpuPmdDuTUaDtvXeToqx2Q] update_mapping [_doc]
[00:02:07]               │ debg Migrating saved objects
[00:02:07]               │ proc [kibana]   log   [19:55:26.556] [info][savedobjects-service] Detected mapping change in "dynamic"
[00:02:07]               │ proc [kibana]   log   [19:55:26.558] [info][savedobjects-service] Creating index .kibana_2.
[00:02:07]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:02:07]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] updating number_of_replicas to [0] for indices [.kibana_2]
[00:02:07]               │ proc [kibana]   log   [19:55:26.619] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:02:07]               │ proc [kibana]   log   [19:55:26.625] [error][savedobjects-service] Error: Unable to migrate the corrupt Saved Object document config:8.0.0. To prevent Kibana from performing a migration on every restart, please delete or fix this document by ensuring that the namespace and type in the document's id matches the values in the namespace and type fields.
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/R414TE7zSTe12G7V8lEjSA] update_mapping [_doc]
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/R414TE7zSTe12G7V8lEjSA] update_mapping [_doc]
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/R414TE7zSTe12G7V8lEjSA] update_mapping [_doc]
[00:02:07]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/R414TE7zSTe12G7V8lEjSA] update_mapping [_doc]
[00:02:08]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1601318359848355586] [.kibana_2/R414TE7zSTe12G7V8lEjSA] update_mapping [_doc]
[00:02:08]               │ proc [kibana]   log   [19:55:26.848] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:02:08]               │ proc [kibana]   log   [19:55:26.898] [info][savedobjects-service] Finished in 342ms.
[00:02:08]             └-> should complete a job of PNG export of a dashboard in non-default space
[00:02:08]             └-> should complete a job of PDF export of a dashboard in non-default space
[00:02:08]             └-: CSV saved search export
[00:02:08]               └-> "before all" hook
[00:02:08]               └-> should use formats from the default space
[00:02:08]                 └-> "before each" hook: global before each
[00:02:08]                 │ debg applying update to kibana config: {"csv:separator":",","dateFormat:tz":"UTC"}
[00:02:08]                 │ debg ReportingAPI.postJobJSON((/api/reporting/generate/csv): {"jobParams":"(conflictedTypesFields:!(),fields:!(order_date,order_date,customer_full_name,taxful_total_price),indexPatternId:aac3e500-f2c7-11ea-8250-fb138aa491e7,metaFields:!(_source,_id,_type,_index,_score),objectType:search,searchRequest:(body:(_source:(includes:!(order_date,customer_full_name,taxful_total_price)),docvalue_fields:!((field:order_date,format:date_time)),query:(bool:(filter:!((match_all:()),(range:(order_date:(format:strict_date_optional_time,gte:'2019-06-11T04:49:43.495Z',lte:'2019-07-14T10:25:34.149Z')))),must:!(),must_not:!(),should:!())),script_fields:(),sort:!((order_date:(order:desc,unmapped_type:boolean))),stored_fields:!(order_date,customer_full_name,taxful_total_price),version:!t),index:'ec*'),title:'EC SEARCH')"})
[00:02:08]                 │ proc [kibana]   log   [19:55:26.932] [info][plugins][reporting] Request uses default Space
[00:02:08]                 │ proc [kibana]   log   [19:55:26.952] [info][plugins][queue-job][reporting] Scheduled CSV report: kfmybq6t5vl37a35bee0knma
[00:02:10]                 │ debg checking report status at /api/reporting/jobs/download/kfmybq6t5vl37a35bee0knma...
[00:02:11]                 │ proc [kibana]   log   [19:55:29.896] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job marked as claimed: /.reporting-2020-09-27/_doc/kfmybq6t5vl37a35bee0knma
[00:02:11]                 │ proc [kibana]   log   [19:55:29.897] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Starting job
[00:02:11]                 │ proc [kibana]   log   [19:55:29.908] [info][plugins][reporting] Request uses default Space
[00:02:11]                 │ proc [kibana]   log   [19:55:30.039] [warning][csv][execute-job][kfmybq6t5vl37a35bee0knma][plugins][reporting] max Size Reached
[00:02:11]                 │ proc [kibana]   log   [19:55:30.042] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job execution completed successfully
[00:02:11]                 │ proc [kibana]   log   [19:55:30.048] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job data saved successfully: /.reporting-2020-09-27/_doc/kfmybq6t5vl37a35bee0knma
[00:02:12]                 │ debg checking report status at /api/reporting/jobs/download/kfmybq6t5vl37a35bee0knma...
[00:02:14]                 │ debg checking report status at /api/reporting/jobs/download/kfmybq6t5vl37a35bee0knma...
[00:02:14]                 │ debg report at /api/reporting/jobs/download/kfmybq6t5vl37a35bee0knma is done
[00:02:14]                 └- ✓ pass  (6.1s) "Reporting APIs Exports and Spaces CSV saved search export should use formats from the default space"
[00:02:14]               └-> should use formats from non-default spaces
[00:02:14]                 └-> "before each" hook: global before each
[00:02:14]                 │ debg ReportingAPI.postJobJSON((/s/non_default_space/api/reporting/generate/csv): {"jobParams":"(conflictedTypesFields:!(),fields:!(order_date,category,customer_first_name,customer_full_name,total_quantity,total_unique_products,taxless_total_price,taxful_total_price,currency),indexPatternId:'067dec90-e7ee-11ea-a730-d58e9ea7581b',metaFields:!(_source,_id,_type,_index,_score),objectType:search,searchRequest:(body:(_source:(includes:!(order_date,category,customer_first_name,customer_full_name,total_quantity,total_unique_products,taxless_total_price,taxful_total_price,currency)),docvalue_fields:!((field:order_date,format:date_time)),query:(bool:(filter:!((match_all:()),(range:(order_date:(format:strict_date_optional_time,gte:'2019-06-11T08:24:16.425Z',lte:'2019-07-13T09:31:07.520Z')))),must:!(),must_not:!(),should:!())),script_fields:(),sort:!((order_date:(order:desc,unmapped_type:boolean))),stored_fields:!(order_date,category,customer_first_name,customer_full_name,total_quantity,total_unique_products,taxless_total_price,taxful_total_price,currency),version:!t),index:'ecommerce*'),title:'Ecom Search')"})
[00:02:14]                 │ proc [kibana]   log   [19:55:33.003] [info][plugins][reporting] Request uses Space ID: non_default_space
[00:02:14]                 │ proc [kibana]   log   [19:55:33.021] [info][plugins][queue-job][reporting] Scheduled CSV report: kfmybuvg5vl37a35bef6mpvy
[00:02:14]                 │ proc [kibana]   log   [19:55:33.059] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job marked as claimed: /.reporting-2020-09-27/_doc/kfmybuvg5vl37a35bef6mpvy
[00:02:14]                 │ proc [kibana]   log   [19:55:33.060] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Starting job
[00:02:14]                 │ proc [kibana]   log   [19:55:33.070] [info][plugins][reporting] Generating request for space: non_default_space
[00:02:14]                 │ proc [kibana]   log   [19:55:33.070] [info][plugins][reporting] Request uses Space ID: non_default_space
[00:02:14]                 │ proc [kibana]   log   [19:55:33.071] [info][plugins][reporting] Creating UI Settings Client for space: non_default_space
[00:02:14]                 │ proc [kibana]   log   [19:55:33.090] [warning][csv][execute-job][kfmybuvg5vl37a35bef6mpvy][plugins][reporting] Kibana Advanced Setting "dateFormat:tz" is set to "Browser". Dates will be formatted as UTC to avoid ambiguity.
[00:02:14]                 │ proc [kibana]   log   [19:55:33.235] [warning][csv][execute-job][kfmybuvg5vl37a35bef6mpvy][plugins][reporting] max Size Reached
[00:02:14]                 │ proc [kibana]   log   [19:55:33.238] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job execution completed successfully
[00:02:14]                 │ proc [kibana]   log   [19:55:33.243] [info][esqueue][plugins][queue-worker][reporting] kfmy8zpv5vl37a35be3sslnq - Job data saved successfully: /.reporting-2020-09-27/_doc/kfmybuvg5vl37a35bef6mpvy
[00:02:16]                 │ debg checking report status at /api/reporting/jobs/download/kfmybuvg5vl37a35bef6mpvy...
[00:02:16]                 │ debg report at /api/reporting/jobs/download/kfmybuvg5vl37a35bef6mpvy is done
[00:02:16]                 └- ✖ fail: Reporting APIs Exports and Spaces CSV saved search export should use formats from non-default spaces
[00:02:16]                 │       Error: expected '"order_date",category,"customer_first_name","customer_full_name","total_quantity","total_unique_products","taxless_total_price","taxful_total_price",currency\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing"",""Women\'s Accessories"",""Men\'s Accessories""]","Sultan Al","Sultan Al Boone",4,4,"173.96","173.96",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Shoes"",""Women\'s Clothing""]",Pia,"Pia Richards",2,2,"41.98","41.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Brigitte,"Brigitte Meyer",2,2,"40.98","40.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Abd,"Abd Mccarthy",2,2,"41.98","41.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Robert,"Robert Banks",2,2,"36.98","36.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing""]",Jim,"Jim Hansen",2,2,"99.98","99.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes""]",Thad,"Thad Lamb",2,2,"39.98","39.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Jim,"JimBryant",2,2,"95.98","95.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Betty,"Betty Roberson",2,2,"57.98","57.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]",Robbie,"Robbie Hubbard",2,2,"74.98","74.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Abigail,"Abigail Willis",2,2,"117.98","117.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Boris,"Boris Greene",2,2,"35.98","35.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Jackson,"Jackson Conner",2,2,"93.98","93.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing""]",Yuri,"Yuri Cross",2,2,"103.98","103.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Irwin,"Irwin Ramsey",2,2,"51.98","51.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Elyssa,"Elyssa Haynes",2,2,"114.98","114.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Selena,"Selena Massey",2,2,"70.98","70.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Abigail,"Abigail Garner",2,2,"37.98","37.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Shoes"",""Women\'s Accessories""]",Elyssa,"Elyssa Foster",2,2,"76.98","76.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]","Ahmed Al","Ahmed Al Underwood",2,2,"85.98","85.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Accessories"",""Men\'s Clothing""]",Marwan,"Marwan Perkins",2,2,"96.98","96.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]",Irwin,"Irwin Barnes",2,2,"119.98","119.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Accessories""]","Rabbia Al","Rabbia Al Barber",2,2,"28.98","28.98",EUR\n' to match /^order_date;category;customer_first_name;customer_full_name;total_quantity;total_unique_products;taxless_total_price;taxful_total_price;currency\nJul 11, 2019 @ 16:00:00.000;/
[00:02:16]                 │       at Assertion.assert (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:100:11)
[00:02:16]                 │       at Assertion.match (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:354:8)
[00:02:16]                 │       at Context.it (test/reporting_api_integration/reporting_and_security/spaces.ts:77:24)
[00:02:16]                 │ 
[00:02:16]                 │

Stack Trace

Error: expected '"order_date",category,"customer_first_name","customer_full_name","total_quantity","total_unique_products","taxless_total_price","taxful_total_price",currency\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing"",""Women\'s Accessories"",""Men\'s Accessories""]","Sultan Al","Sultan Al Boone",4,4,"173.96","173.96",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Shoes"",""Women\'s Clothing""]",Pia,"Pia Richards",2,2,"41.98","41.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Brigitte,"Brigitte Meyer",2,2,"40.98","40.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Abd,"Abd Mccarthy",2,2,"41.98","41.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Robert,"Robert Banks",2,2,"36.98","36.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing""]",Jim,"Jim Hansen",2,2,"99.98","99.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes""]",Thad,"Thad Lamb",2,2,"39.98","39.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Jim,"Jim Bryant",2,2,"95.98","95.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Betty,"Betty Roberson",2,2,"57.98","57.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]",Robbie,"Robbie Hubbard",2,2,"74.98","74.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Abigail,"Abigail Willis",2,2,"117.98","117.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Boris,"Boris Greene",2,2,"35.98","35.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Jackson,"Jackson Conner",2,2,"93.98","93.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Shoes"",""Men\'s Clothing""]",Yuri,"Yuri Cross",2,2,"103.98","103.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing""]",Irwin,"Irwin Ramsey",2,2,"51.98","51.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Elyssa,"Elyssa Haynes",2,2,"114.98","114.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Shoes""]",Selena,"Selena Massey",2,2,"70.98","70.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing""]",Abigail,"Abigail Garner",2,2,"37.98","37.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Shoes"",""Women\'s Accessories""]",Elyssa,"Elyssa Foster",2,2,"76.98","76.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]","Ahmed Al","Ahmed Al Underwood",2,2,"85.98","85.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Accessories"",""Men\'s Clothing""]",Marwan,"Marwan Perkins",2,2,"96.98","96.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Men\'s Clothing"",""Men\'s Shoes""]",Irwin,"Irwin Barnes",2,2,"119.98","119.98",EUR\n"Jul 12, 2019 @ 00:00:00.000","[""Women\'s Clothing"",""Women\'s Accessories""]","Rabbia Al","Rabbia Al Barber",2,2,"28.98","28.98",EUR\n' to match /^order_date;category;customer_first_name;customer_full_name;total_quantity;total_unique_products;taxless_total_price;taxful_total_price;currency\nJul 11, 2019 @ 16:00:00.000;/
    at Assertion.assert (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.match (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:354:8)
    at Context.it (test/reporting_api_integration/reporting_and_security/spaces.ts:77:24)

Metrics [docs]

async chunks size

id	value	diff	baseline
ml	8.9MB	+160.0B	8.9MB

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[ML] DF Analytics creation: ensure job did not fail to start before s…

1714959

…howing results link (elastic#78200) * ensure job did not fail to start before showing results link * simplify job started check * update job finished check

alvarezmelissa87 added backport :ml Feature:Data Frame Analytics ML data frame analytics features labels Sep 28, 2020

alvarezmelissa87 merged commit 5eae936 into elastic:7.x Sep 28, 2020

alvarezmelissa87 deleted the backport/7.x/pr-78200 branch September 28, 2020 23:59

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[7.x] [ML] DF Analytics creation: ensure job did not fail to start before showing results link (#78200) #78664

[7.x] [ML] DF Analytics creation: ensure job did not fail to start before showing results link (#78200) #78664

alvarezmelissa87 commented Sep 28, 2020

elasticmachine commented Sep 28, 2020

kibanamachine commented Sep 28, 2020

Standard Out

Stack Trace

[7.x] [ML] DF Analytics creation: ensure job did not fail to start before showing results link (#78200) #78664

[7.x] [ML] DF Analytics creation: ensure job did not fail to start before showing results link (#78200) #78664

Conversation

alvarezmelissa87 commented Sep 28, 2020

elasticmachine commented Sep 28, 2020

kibanamachine commented Sep 28, 2020

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Metrics [docs]

async chunks size