Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider persisting/restoring the streaming metadata (last evicted) cache on silo shutdown/startup #9350

Open
oising opened this issue Feb 13, 2025 · 0 comments

Comments

@oising
Copy link
Contributor

oising commented Feb 13, 2025

I had a conversation with @benjaminpetit some months ago about this, and I think we both agreed that this would help with the QueueCacheException storm that may happen during a rolling upgrade or otherwise planned restart of a cluster. The issue is that while the cache is reloaded from checkpoint data, the in-memory dictionary of streamId->lastEvictedSequenceToken is lost. This serves as a secondary mechanism to keep an eye on the n-1,n validation for dropped message detection.

@oising oising changed the title Consider persisting/restoring the streaming metadata (last evicated) cache on silo shutdown/startup Consider persisting/restoring the streaming metadata (last evicted) cache on silo shutdown/startup Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant