Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated migration guide for selective algorithm improvements in chang… #701

Merged
merged 1 commit into from
Feb 6, 2017

Conversation

chemicL
Copy link
Contributor

@chemicL chemicL commented Jan 31, 2017

…elog

CHANGELOG.md Outdated
@@ -8,6 +8,12 @@ Improved durability of assignments during restarts and zookeeper flaps.
Reporting of assignments and running consumers has been improved and made consistent.
More reliable handling of consumer processes.

Migration guide:

To utilize these improvements it is required to stop all instances in hermes cluster, remove all nodes from <zookeeper.root>/consumers-workload/<kafka.cluster.name>/runtime and restart instances.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missing code quotes in path, also maybe use {} to denote placeholder?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changed

@chemicL chemicL force-pushed the selective_algorithm_migration branch 2 times, most recently from 2626170 to 89b5f75 Compare January 31, 2017 16:30
@chemicL chemicL force-pushed the selective_algorithm_migration branch from 89b5f75 to 8ef46b2 Compare January 31, 2017 23:46

This adds a marker in selective algorithm's consumer assignments, which allows rebalancing with removing automatically created assignments.

Alternatively, to avoid switching off your cluster, a script updating assignments' zookeeper nodes' data to `AUTO_ASSIGNED` can be used. It should be also applied after all nodes run the new version, as previous run could shuffle assignments during deployment.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I observed that the previous version almost certainly shuffles assignments during a rolling update to the latest version, so I needed to re-run the script.

@adamdubiel adamdubiel added this to the 0.10.6 milestone Feb 6, 2017
@adamdubiel adamdubiel merged commit f1c89d4 into develop Feb 6, 2017
@adamdubiel adamdubiel deleted the selective_algorithm_migration branch February 6, 2017 15:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants