Ra 2.5.0 #7553
Merged
Ra 2.5.0 #7553
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This Ra release includes improvements to Ra server GC behaviour when receiving a lot of low priority commands with large binary payloads (e.g. quorum queue messages). Practically this allows quorum queues to accept large amounts of messages in a more predicatble and performant manner. This change also removes ra_file_handle cache that was used as a bridge between ra file operations and RabbitMQ io metrics. Lots of components in RabbitMQ such as streams and CQv2s do not record io metrics in the previous manner due to overhead incurred for every file io operation. These metrics are better inspected at the OS level anyway.
michaelklishin
added
backport-v3.11.x
backport-v3.12.x
and removed
backport-v3.11.x
labels
|
Link to full performance test results: The original goal of this change was to address degradation under sustained publisher load without consumers - when the queue grew longer, its throughput quickly degraded. This has been resolved:
Whit this PR, single queue (publisher+consumer) throughput is higher for all tested message sizes: In tests where an initial backlog is created and then consumers start (in the first test here - 10 consumers, in the second - SAC), this PR allows to recover publishing throughput quickly and provides much higher consumption rate in the SAC scenario: |
michaelklishin
added a commit
that referenced
this pull request
Mar 10, 2023
Ra 2.5.0 (backport #7553)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This Ra release includes improvements to Ra server GC behaviour when receiving a lot of low priority commands with large binary payloads (e.g. quorum queue messages).
Practically this allows quorum queues to accept large amounts of messages in a more predicatble and performant manner.
This change also removes ra_file_handle cache that was used as a bridge between ra file operations and RabbitMQ io metrics. Lots of components in RabbitMQ such as streams and CQv2s do not record io metrics in the previous manner due to overhead incurred for every file io operation. These metrics are better inspected at the OS level anyway.