Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Remote Publication Cluster State Download Task Management. #17412

Open
SwethaGuptha opened this issue Feb 21, 2025 · 0 comments
Open

[BUG] Remote Publication Cluster State Download Task Management. #17412

SwethaGuptha opened this issue Feb 21, 2025 · 0 comments
Labels
bug Something isn't working Cluster Manager untriaged

Comments

@SwethaGuptha
Copy link
Contributor

SwethaGuptha commented Feb 21, 2025

Describe the bug

A node at any point in time should only have one task in-going for downloading latest cluster state. For a cluster with remote-publication, this management of task has gaps due to which the node can have more than one ongoing cluster state download task. We can re-visit the task management to address the common scenarios like:

  1. If a node receive a new cluster state download task with the version that is same as the ongoing cluster state download task then it can be de-duped.
  2. If the new cluster state task has higher version than the version of ongoing download task then the ongoing task must be cancelled.

Related component

Cluster Manager

To Reproduce

  1. Create a cluster with data nodes having 2vcpu
  2. Create 10k indices
  3. Simulate node drop

Expected behavior

Have only one cluster state download task at any point in time.

Additional Details

Plugins
Please list all plugins currently enabled.

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: [e.g. iOS]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Cluster Manager untriaged
Projects
Status: 🆕 New
Development

No branches or pull requests

1 participant