Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose ignore_throttled as an option for _msearch #26244

Closed
s1monw opened this issue Nov 27, 2018 · 6 comments
Closed

Expose ignore_throttled as an option for _msearch #26244

s1monw opened this issue Nov 27, 2018 · 6 comments
Assignees
Labels
enhancement New value added to drive a business result Team:Visualizations Visualization editors, elastic-charts and infrastructure

Comments

@s1monw
Copy link

s1monw commented Nov 27, 2018

In elasticsearch starting with version 6.6 we have a new beta feature called frozen indices. Frozen indices will not be search on by default unless a the request option ignore_throttled=false is set. This is mainly to protect users from running slowish requests with a index pattern etc. Yet, frozen indices also have a protection that allows fast evaluation of date-ranges which makes it suitable for kibana since even if a pattern expands to a frozen index the query will be likely very fast unless it can match. Yet, before we enable anything by default we should at least have an option to opt-in to this feature similar to what we have done here This would allow folks to try frozen indices through kibana. Down the road we might even enable this feature by default.

@rayafratkina rayafratkina added the Team:Visualizations Visualization editors, elastic-charts and infrastructure label Nov 27, 2018
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-app

@rayafratkina rayafratkina added triage_needed enhancement New value added to drive a business result labels Nov 27, 2018
@timroes timroes changed the title Expose ingore_throttled as an option for _msearch Expose ignore_throttled as an option for _msearch Dec 11, 2018
@timroes
Copy link
Contributor

timroes commented Dec 11, 2018

As of a discussion with PMs we just decided, that we will add a new setting to Kibana "Search in Frozen index" (name is WIP), which will default to off. A user can enable this (on a per space level, as most of the settings), and if that's enabled we will add the ignore_throttled=false parameter to all current Kibana App places (Graph, Courier, TSVB, Timelion), that execute an _search or _msearch request.

@s1monw
Copy link
Author

s1monw commented Dec 11, 2018

++ thanks @timroes

@AlonaNadler
Copy link

@grabowskit @alexfrancoeur @tsg @tbragin above is our plan for frozen indices in Kibana. The first phase will include a global setting that enables search on frozen indices, in the future and based on feedback we might consider making this setting per index pattern.
Please let us know if you have any other considerations we should take into account

@alexfrancoeur
Copy link

Thanks for the ping @AlonaNadler. If this is enabled, do we have to worry about client side timeouts at all? Do we need to consider any of these changes for reporting (CSV & PDF)?

@tbragin
Copy link
Contributor

tbragin commented Dec 16, 2018

cc @makwarth @roncohen @alvarolobato FYI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Team:Visualizations Visualization editors, elastic-charts and infrastructure
Projects
None yet
Development

No branches or pull requests

8 participants