-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Broker OffsetCommit API support #85
Comments
Hi We would really like be able to use this, any ideas when 0.8.4 will be available. Many thanks |
@pookieman Within 1-2 weeks probably. |
Actually what we are looking for is https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Finding Starting Offset for Reads - section. It would be great if we could just pick up the latest message on a topic. Currently we have to read from the beginning then disregard everything but the last one. Cheers |
If you don't care about losing messages produced while your consumer is
|
Otherwise use file based offsets (already available) or wait for 0.8.4 and its broker based offsets (requires apache kafka 0.8.1 on the broker side). |
Not sure what file based offsets are will look at this tomorrow. The problem with RD_KAFKA_.._OFFSET_END is that I want the last message, so when the consumer starts it doesn't have to block until something has been published. Cheers |
File based offset storage writes the last commited (consumed..) offset to a file (one per topic+partition combo). |
* Offsets can now be commited and read from the broker. * Requires Apache Kafka 0.8.1 on the broker * added config property offset.store.method = file|broker (default: file)
The OffsetCommit API has now be implemented, enable it by setting the topic configuration property Please verify on your side. |
The offset API was added to Apache Kafka 0.8.1.
librdkafka should support it.
The text was updated successfully, but these errors were encountered: