Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: disable backfill success check #139219

Merged

Conversation

andrewbaptist
Copy link
Contributor

The perturbation/*/backfill tests are flaky and are failing at least once a week with the default configuration. This change temporarily disables the check to allow easier investigation of the other failure modes such as backfill failing to complete and node OOMs. Once those are closed, and the test is running more stably, this threshold can be dropped.

Fixes: #137093
Fixes: #137392

Informs: #133114

Release note: None

@cockroach-teamcity
Copy link
Member

This change is Reviewable

Comment on lines 31 to 32
// TODO(baptist): Track down why this test causes stalls and drop the value
// to something more reasonable (like 5) once this is done.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have an issue we can reference here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea. I created #139262.

The perturbation/*/backfill tests are flaky and are failing at least
once a week with the default configuration. This change temporarily
disables the check to allow easier investigation of the other failure
modes such as backfill failing to complete and node OOMs. Once those are
closed, and the test is running more stably, this threshold can be
dropped.

Fixes: cockroachdb#137093
Fixes: cockroachdb#137392

Informs: cockroachdb#133114
Informs: cockroachdb#139262

Release note: None
@andrewbaptist andrewbaptist force-pushed the 2025-01-16-disable-backfill-check branch from b8aabd0 to 1a6bbf3 Compare January 16, 2025 21:04
@andrewbaptist
Copy link
Contributor Author

TFTR!

bors r=stevendanna

@craig craig bot merged commit f118d51 into cockroachdb:master Jan 16, 2025
21 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

roachtest: perturbation/metamorphic/backfill failed roachtest: perturbation/full/backfill failed
4 participants