Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is compression in fact supported? #47

Closed
winbatch opened this issue Jan 2, 2014 · 4 comments
Closed

Is compression in fact supported? #47

winbatch opened this issue Jan 2, 2014 · 4 comments

Comments

@winbatch
Copy link

winbatch commented Jan 2, 2014

The introduction seems to indicate yes, but the rdkafka_int.h indicates no/not supported in the enum definition of rd_kafka_compression_t. Hoping that it's simply outdated?

@edenhill
Copy link
Contributor

edenhill commented Jan 2, 2014

Those comments are indeed outdated, compression is supported.
I will remove the comments.

Thanks

@winbatch
Copy link
Author

winbatch commented Jan 2, 2014

Cool. Can you confirm that when a consumer receives a message, he has no way of knowing whether it is compressed and by what algorithm, correct? (So a mutual understanding is required between producer and consumer?)

@edenhill
Copy link
Contributor

edenhill commented Jan 2, 2014

The compression codec used is set in the message header and the consumer will decompress the message accordingly. This also allows for some producers to employ compression and some dont, while producing to the same topic and partition.

So there is no need for any producer <-> consumer correlation.

@winbatch
Copy link
Author

winbatch commented Jan 2, 2014

Excellent. Will give it a shot. Thanks again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants