-
Notifications
You must be signed in to change notification settings - Fork 289
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
sink/kafka: batch send messages #426
Conversation
Signed-off-by: 5kbpers <[email protected]>
Signed-off-by: 5kbpers <[email protected]>
/run-kafka-tests |
/run-kafka-tests |
/run-kafka-tests |
1 similar comment
/run-kafka-tests |
6dc3b0a
to
2cc6079
Compare
Signed-off-by: 5kbpers <[email protected]>
Signed-off-by: 5kbpers <[email protected]>
/run-kafka-tests |
Signed-off-by: 5kbpers <[email protected]>
/run-kafka-tests |
deff569
to
d6f4659
Compare
Signed-off-by: 5kbpers <[email protected]>
/run-kafka-tests |
Signed-off-by: 5kbpers <[email protected]>
/run-kafka-tests |
/run-kafka-tests |
/run-kafka-tests |
/run-kafka-tests |
/run-kafka-tests |
/run-all-tests |
Codecov Report
@@ Coverage Diff @@
## master #426 +/- ##
===========================================
Coverage 30.0229% 30.0229%
===========================================
Files 58 58
Lines 5669 5669
===========================================
Hits 1702 1702
Misses 3852 3852
Partials 115 115 |
/run-all-tests |
/run-kafka-tests |
/run-kafka-tests |
/run-integration-tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Rest LGTM
cdc/sink/mqProducer/kafka.go
Outdated
return nil | ||
} | ||
|
||
func (k *kafkaSaramaProducer) BroadcastMessage(ctx context.Context, key *model.MqMessageKey, value *model.MqMessageDDL) error { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this can be removed now?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated
/run-all-tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Signed-off-by: 5kbpers <[email protected]> Co-authored-by: leoppro <[email protected]>
Signed-off-by: 5kbpers [email protected]
What problem does this PR solve?
The throughput of kafka sink needs to be improved.
What is changed and how it works?
Batch send messages to consumer
Check List
Tests
Code changes
Side effects
Related changes