Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Produce - KIP 467 - v8 #4583

Merged
merged 8 commits into from
Apr 15, 2024
Merged

Produce - KIP 467 - v8 #4583

merged 8 commits into from
Apr 15, 2024

Conversation

anchitj
Copy link
Member

@anchitj anchitj commented Jan 16, 2024

  • Bumped produce API to v8. Added support for record_errors and error_msg fields.
  • Made RD_KAFKA_RESP_ERR_INVALID_MSG retriable.

@anchitj anchitj force-pushed the dev_produce_kip_467_test branch 7 times, most recently from daba407 to c22ba01 Compare January 24, 2024 09:29
@anchitj anchitj force-pushed the dev_produce_kip_467_test branch 3 times, most recently from 733f3c8 to c90c919 Compare January 30, 2024 07:22
@anchitj anchitj force-pushed the dev_produce_kip_467_test branch from 847ef5b to 1189944 Compare March 20, 2024 08:43
@anchitj anchitj force-pushed the dev_produce_kip_467_test branch from 1189944 to 2e2091c Compare March 20, 2024 08:45
@anchitj anchitj changed the title Dev produce kip 467 test Produce - KIP 467 - v8 Mar 20, 2024
@anchitj anchitj requested a review from emasab March 20, 2024 08:46
@anchitj anchitj marked this pull request as ready for review March 20, 2024 09:14
Copy link
Contributor

@emasab emasab left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks Anchit

@@ -139,6 +139,7 @@ int rd_kafka_err_action(rd_kafka_broker_t *rkb,
case RD_KAFKA_RESP_ERR__TIMED_OUT:
case RD_KAFKA_RESP_ERR_REQUEST_TIMED_OUT:
case RD_KAFKA_RESP_ERR_NOT_ENOUGH_REPLICAS_AFTER_APPEND:
case RD_KAFKA_RESP_ERR_INVALID_MSG:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move it down below after RD_KAFKA_RESP_ERR_NOT_ENOUGH_REPLICAS as we know for sure the batch wasn't persisted

rkmessages = calloc(sizeof(*rkmessages), msgcnt);
for (i = 0; i < msgcnt; i++) {
int *msgidp = malloc(sizeof(*msgidp));
char *t;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove unused variable

@emasab emasab enabled auto-merge (squash) April 10, 2024 16:21
Copy link
Member

@pranavrth pranavrth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!.

@emasab emasab merged commit 8532a0e into master Apr 15, 2024
3 checks passed
@emasab emasab deleted the dev_produce_kip_467_test branch April 15, 2024 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants