Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ESQL: Grow heap attack tests #121714

Merged
merged 3 commits into from
Feb 5, 2025
Merged

Conversation

nik9000
Copy link
Member

@nik9000 nik9000 commented Feb 4, 2025

This causes the ESQL heap attack tests to grow their memory usage if they first don't cause a circuit breaking exception. It just tries again with more data. That's slow, but it should stop this from failing quite as much. And it'll give us even more information about failures.

Closes #121465

This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes elastic#121465
@nik9000 nik9000 added >test Issues or PRs that are addressing/adding tests auto-backport Automatically create backport pull requests when merged :Analytics/ES|QL AKA ESQL v9.0.0 v8.18.0 v8.19.0 v9.1.0 labels Feb 4, 2025
@nik9000 nik9000 requested a review from alex-spies February 4, 2025 21:44
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Feb 4, 2025
attempt++;
} catch (ResponseException e) {
Map<?, ?> map = responseAsMap(e.getResponse());
logger.info("expected circuit breaker {}", map);
Copy link
Contributor

@idegtiarenko idegtiarenko Feb 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is expected, I wonder if we should log it at all...
May be it is wroth adding attempt here if we decide to log it anyway.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it really isn't worth it. We get it from the assertion bit if there's a failure.

while (attempt <= MAX_ATTEMPTS) {
try {
Map<String, Object> response = tryBreaking.attempt(attempt);
logger.error("{}: should circuit broken but got {}", attempt, response);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets change it to warn since it is retryable.

}
}
fail("giving up circuit breaking after " + attempt + " attempts");
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@nik9000 nik9000 enabled auto-merge (squash) February 5, 2025 19:10
@nik9000
Copy link
Member Author

nik9000 commented Feb 5, 2025

run elasticsearch-ci/part-1

@nik9000 nik9000 disabled auto-merge February 5, 2025 19:51
@nik9000 nik9000 enabled auto-merge (squash) February 5, 2025 19:51
@nik9000
Copy link
Member Author

nik9000 commented Feb 5, 2025

@elasticsearchmachine, run elasticsearch-ci/part-1

@nik9000 nik9000 merged commit 85da28d into elastic:main Feb 5, 2025
11 of 17 checks passed
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
9.0 Commit could not be cherrypicked due to conflicts
8.18 Commit could not be cherrypicked due to conflicts
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 121714

nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Feb 5, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes elastic#121465
nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Feb 5, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes elastic#121465
nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Feb 5, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes elastic#121465
@nik9000
Copy link
Member Author

nik9000 commented Feb 5, 2025

Backports:
9.0: #121830
8.19: #121831
8.18: #121832

nik9000 added a commit that referenced this pull request Feb 5, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes #121465
elasticsearchmachine pushed a commit that referenced this pull request Feb 5, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes #121465
nik9000 added a commit that referenced this pull request Feb 6, 2025
This causes the ESQL heap attack tests to grow their memory usage if
they first don't cause a circuit breaking exception. It just tries again
with more data. That's slow, but it should stop this from failing quite
as much. And it'll give us even more information about failures.

Closes #121465
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL auto-backport Automatically create backport pull requests when merged backport pending Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test Issues or PRs that are addressing/adding tests v8.18.0 v8.19.0 v9.0.0 v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] HeapAttackIT testLookupExplosionBigStringManyMatches failing
3 participants