Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pre-compute aggregations to optimize scaling recording rules #284

Merged
merged 2 commits into from
Mar 31, 2021

Conversation

pracucci
Copy link
Collaborator

What this PR does:
Based on feedback received in #283 (comment), in this PR I'm proposing to pre-compute aggregations to try to optimize the scaling recording rules.

I haven't splitted recording rules into multiple groups in this PR in order to keep the diff easier to review.

Which issue(s) this PR fixes:
N/A

Checklist

  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@pracucci pracucci requested a review from beorn7 March 30, 2021 06:29
@pracucci pracucci requested a review from a team as a code owner March 30, 2021 06:29
)
)[24h:5m]
)
quantile_over_time(0.99, cluster_namespace_deployment:container_memory_usage_bytes:sum[24h:5m])
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ditto here.

Copy link
Contributor

@beorn7 beorn7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd try the [24h] first. If that works out, great. Otherwise, we can play with the [24h:5m].

cortex-mixin/recording_rules.libsonnet Outdated Show resolved Hide resolved
Signed-off-by: Marco Pracucci <[email protected]>
@pracucci
Copy link
Collaborator Author

Thanks @beorn7 for your detailed reply. I see your point. I removed the :5m step.

@pracucci pracucci requested a review from beorn7 March 31, 2021 09:00
@beorn7
Copy link
Contributor

beorn7 commented Mar 31, 2021

Let's see how it works out.

@pracucci pracucci merged commit cfea7c8 into main Mar 31, 2021
@pracucci pracucci deleted the optimize-recording-rules branch March 31, 2021 10:23
simonswine pushed a commit to grafana/mimir that referenced this pull request Oct 18, 2021
…ecording-rules

Pre-compute aggregations to optimize scaling recording rules
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants