Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove MergeParts internal telemetry device #764

Merged
merged 3 commits into from
Sep 7, 2019

Conversation

ebadyano
Copy link
Contributor

@ebadyano ebadyano commented Sep 5, 2019

Remove the Merge Parts telemetry device, which would display different merge times as reported by Lucene only when Lucene index writer trace logging was enabled (--car-params="verbose_iw_logging_enabled:true"). The following metric keys will not be gathered anymore: merge_parts_total_time_* where * is one of postings, stored fields, doc values, norms, vectors, points

Closes #754

@ebadyano ebadyano added :Telemetry Telemetry Devices that gather additional metrics :Benchmark Candidate Management Anything affecting how Rally sets up Elasticsearch labels Sep 5, 2019
@ebadyano ebadyano added this to the 1.3.0 milestone Sep 5, 2019
@ebadyano ebadyano changed the title Remove MergeParts internal telemetry device WIP: Remove MergeParts internal telemetry device Sep 5, 2019
@ebadyano ebadyano changed the title WIP: Remove MergeParts internal telemetry device Remove MergeParts internal telemetry device Sep 5, 2019
@ebadyano ebadyano requested review from danielmitterdorfer and dliappis and removed request for danielmitterdorfer September 5, 2019 14:59
@danielmitterdorfer danielmitterdorfer added the breaking Non-backwards compatible change label Sep 6, 2019
Copy link
Member

@danielmitterdorfer danielmitterdorfer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! The change looks mostly fine but I left a comment around an unused import. As this is a breaking change (we're removing existing functionality), can you please provide a bit more context in the PR description on the consequences (a short summary of what metrics will not be gathered anymore and what will change in the report) so interested users can get more details without needing to go through all of the changes in the PR?

"""
Gathers merge parts time statistics. Note that you need to run a track setup which logs these data.
"""
MERGE_TIME_LINE = re.compile(r": (\d+) msec to merge ([a-z ]+) \[(\d+) docs\]")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This results in (at least) one new unused import re in this module. Can you please check unused imports and remove them?

@ebadyano ebadyano merged commit 584cb91 into elastic:master Sep 7, 2019
@danielmitterdorfer danielmitterdorfer added the enhancement Improves the status quo label Sep 9, 2019
danielmitterdorfer added a commit to danielmitterdorfer/rally that referenced this pull request Sep 10, 2019
With this commit we remove all merge time related metrics from the
command line report as they are not measured anymore since elastic#764.

Relates elastic#764
danielmitterdorfer added a commit that referenced this pull request Sep 10, 2019
With this commit we remove all merge time related metrics from the
command line report as they are not measured anymore since #764.

Relates #764
Relates #767
novosibman pushed a commit to novosibman/rally that referenced this pull request Oct 2, 2019
Remove the Merge Parts telemetry device, which would display different merge times as reported by Lucene only when Lucene index writer trace logging was enabled (`--car-params="verbose_iw_logging_enabled:true"`). The following metric keys will not be gathered anymore: `merge_parts_total_time_*` where * is one of `postings, stored fields, doc values, norms, vectors, points`

Closes elastic#754
novosibman pushed a commit to novosibman/rally that referenced this pull request Oct 2, 2019
With this commit we remove all merge time related metrics from the
command line report as they are not measured anymore since elastic#764.

Relates elastic#764
Relates elastic#767
@ebadyano ebadyano deleted the master-removemergeparts branch December 16, 2022 15:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Benchmark Candidate Management Anything affecting how Rally sets up Elasticsearch breaking Non-backwards compatible change enhancement Improves the status quo :Telemetry Telemetry Devices that gather additional metrics
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove MergeParts internal telemetry device
2 participants