Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Producer with .net cannot write to kafka cluster #2437

Closed
1 of 2 tasks
better2being opened this issue Jul 29, 2019 · 3 comments
Closed
1 of 2 tasks

Producer with .net cannot write to kafka cluster #2437

better2being opened this issue Jul 29, 2019 · 3 comments

Comments

@better2being
Copy link

better2being commented Jul 29, 2019 •
edited by edenhill
Loading

Description

my producer with .net cannot write to kafka cluster, it is same as the Confluent Example(Confluent.Kafka: 0.11.6), except below config:
{"security.protocol","SASL_PLAINTEXT" },
{"sasl.mechanism","PLAIN" },
{"sasl.username","xxx" },//
{"sasl.password","xxx" },//
the problem is it can connect with cluster, but can't write message.
it is like blocked.

How to reproduce

7|2019-07-29 20:39:21.357|rdkafka#producer-1|SASL| [thrd:app]: Selected provider PLAIN (builtin) for SASL mechanism PLAIN                        
7|2019-07-29 20:39:21.379|rdkafka#producer-1|BRKMAIN| [thrd::0/internal]: :0/internal: Enter main broker thread                                  
7|2019-07-29 20:39:21.380|rdkafka#producer-1|STATE| [thrd::0/internal]: :0/internal: Broker changed state INIT -> UP                             
7|2019-07-29 20:39:21.380|rdkafka#producer-1|BROKER| [thrd:app]: sasl_plaintext://99.12.143.120:9093/bootstrap: Added new broker with NodeId -1  
7|2019-07-29 20:39:21.380|rdkafka#producer-1|BRKMAIN| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: Enter main broker thread                                                                                                               
7|2019-07-29 20:39:21.382|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: broker in state INIT connecting                                                                                                        
7|2019-07-29 20:39:21.381|rdkafka#producer-1|BROKER| [thrd:app]: sasl_plaintext://99.12.141.128:9093/bootstrap: Added new broker with NodeId -1  
7|2019-07-29 20:39:21.382|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: Connecting to ipv4#99.12.143.120:9093 (sasl_plaintext) with socket 900                                                                 
7|2019-07-29 20:39:21.382|rdkafka#producer-1|BRKMAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: Enter main broker thread                                                                                                               
7|2019-07-29 20:39:21.383|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: broker in state INIT connecting                                                                                                        
7|2019-07-29 20:39:21.383|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boo
tstrap: Broker changed state INIT -> CONNECT                                                                                                     
7|2019-07-29 20:39:21.384|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: Connecting to ipv4#99.12.141.128:9093 (sasl_plaintext) with socket 964                                                                 
7|2019-07-29 20:39:21.384|rdkafka#producer-1|BROKER| [thrd:app]: sasl_plaintext://99.12.141.43:9093/bootstrap: Added new broker with NodeId -1   
7|2019-07-29 20:39:21.384|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: Connected to ipv4#99.12.143.120:9093                                                                                                   
7|2019-07-29 20:39:21.385|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093
/bootstrap: Connected (#1)                                                                                                                       
7|2019-07-29 20:39:21.385|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: Updated enabled protocol features +ApiVersion to ApiVersion                                                                            
7|2019-07-29 20:39:21.386|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boo
tstrap: Broker changed state CONNECT -> APIVERSION_QUERY                                                                                         
7|2019-07-29 20:39:21.387|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Sent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 1)                                                                                       
7|2019-07-29 20:39:21.384|rdkafka#producer-1|BRKMAIN| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: Enter main broker thread                                                                                                                 
7|2019-07-29 20:39:21.387|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Received ApiVersionResponse (v0, 120 bytes, CorrId 1, rtt 0.54ms)                                                                         
7|2019-07-29 20:39:21.384|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boo
tstrap: Broker changed state INIT -> CONNECT                                                                                                     
7|2019-07-29 20:39:21.388|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: Connected to ipv4#99.12.141.128:9093                                                                                                   
7|2019-07-29 20:39:21.388|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/bootstrap: Connected (#1)                                                                                                                       
7|2019-07-29 20:39:21.386|rdkafka#producer-1|BROKER| [thrd:app]: sasl_plaintext://99.12.143.35:9093/bootstrap: Added new broker with NodeId -1   
7|2019-07-29 20:39:21.390|rdkafka#producer-1|INIT| [thrd:app]: librdkafka v0.11.6 (0xb06ff) rdkafka#producer-1 initialized (builtin.features 0xff
ff, debug 0x28a)                                                                                                                                 
7|2019-07-29 20:39:21.388|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/b
ootstrap: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,L
Z4                                                                                                                                               
7|2019-07-29 20:39:21.397|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Auth in state APIVERSION_QUERY (handshake supported)                                                                                      
7|2019-07-29 20:39:21.398|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boo
tstrap: Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                  
7|2019-07-29 20:39:21.399|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Sent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 2)                                                                                    
7|2019-07-29 20:39:21.399|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Received SaslHandshakeResponse (v0, 13 bytes, CorrId 2, rtt 0.64ms)                                                                       
7|2019-07-29 20:39:21.400|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093
/bootstrap: Broker supported SASL mechanisms: PLAIN                                                                                              
7|2019-07-29 20:39:21.401|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Auth in state AUTH_HANDSHAKE (handshake supported)                                                                                        
7|2019-07-29 20:39:21.402|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boo
tstrap: Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                              
7|2019-07-29 20:39:21.403|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Initializing SASL client: service name kafka, hostname 99.12.143.120, mechanisms PLAIN, provider PLAIN (builtin)                          
7|2019-07-29 20:39:21.403|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093
/bootstrap: Sending SASL PLAIN (builtin) authentication token                                                                                    
7|2019-07-29 20:39:21.404|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Send SASL frame to broker (15 bytes)                                                                                                      
7|2019-07-29 20:39:21.388|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: broker in state INIT connecting                                                                                                          
7|2019-07-29 20:39:21.390|rdkafka#producer-1|BRKMAIN| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: Enter main broker thread                                                                                                                 
7|2019-07-29 20:39:21.407|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: broker in state INIT connecting                                                                                                          
7|2019-07-29 20:39:21.409|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: Connecting to ipv4#99.12.143.35:9093 (sasl_plaintext) with socket 1112                                                                   
7|2019-07-29 20:39:21.409|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boots
trap: Broker changed state INIT -> CONNECT                                                                                                       
7|2019-07-29 20:39:21.411|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: Connected to ipv4#99.12.143.35:9093                                                                                                      
7|2019-07-29 20:39:21.413|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/b
ootstrap: Connected (#1)                                                                                                                         
7|2019-07-29 20:39:21.406|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: Connecting to ipv4#99.12.141.43:9093 (sasl_plaintext) with socket 1100                                                                   
7|2019-07-29 20:39:21.416|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: Updated enabled protocol features +ApiVersion to ApiVersion                                                                              
7|2019-07-29 20:39:21.417|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boots
trap: Broker changed state CONNECT -> APIVERSION_QUERY                                                                                           
7|2019-07-29 20:39:21.389|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: Updated enabled protocol features +ApiVersion to ApiVersion                                                                            
7|2019-07-29 20:39:21.420|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Sent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 1)                                                                                         
7|2019-07-29 20:39:21.420|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boo
tstrap: Broker changed state CONNECT -> APIVERSION_QUERY                                                                                         
7|2019-07-29 20:39:21.417|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boots
trap: Broker changed state INIT -> CONNECT                                                                                                       
7|2019-07-29 20:39:21.423|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: Connected to ipv4#99.12.141.43:9093                                                                                                      
7|2019-07-29 20:39:21.424|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/b
ootstrap: Connected (#1)                                                                                                                         
7|2019-07-29 20:39:21.425|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: Updated enabled protocol features +ApiVersion to ApiVersion                                                                              
7|2019-07-29 20:39:21.426|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boots
trap: Broker changed state CONNECT -> APIVERSION_QUERY                                                                                           
7|2019-07-29 20:39:21.427|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Sent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 1)                                                                                         
7|2019-07-29 20:39:21.428|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Received ApiVersionResponse (v0, 120 bytes, CorrId 1, rtt 1.26ms)                                                                           
7|2019-07-29 20:39:21.429|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boo
tstrap: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4
                                                                                                                                                 
7|2019-07-29 20:39:21.430|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Auth in state APIVERSION_QUERY (handshake supported)                                                                                        
7|2019-07-29 20:39:21.431|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boots
trap: Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                    
7|2019-07-29 20:39:21.432|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Sent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 2)                                                                                      
7|2019-07-29 20:39:21.426|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Received ApiVersionResponse (v0, 120 bytes, CorrId 1, rtt 5.86ms)                                                                           
7|2019-07-29 20:39:21.436|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boo
tstrap: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4
                                                                                                                                                 
7|2019-07-29 20:39:21.438|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Auth in state APIVERSION_QUERY (handshake supported)                                                                                        
7|2019-07-29 20:39:21.438|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boots
trap: Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                    
7|2019-07-29 20:39:21.439|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Sent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 2)                                                                                      
7|2019-07-29 20:39:21.422|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Sent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 1)                                                                                       
7|2019-07-29 20:39:21.441|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Received SaslHandshakeResponse (v0, 13 bytes, CorrId 2, rtt 1.33ms)                                                                         
7|2019-07-29 20:39:21.442|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/b
ootstrap: Broker supported SASL mechanisms: PLAIN                                                                                                
7|2019-07-29 20:39:21.442|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Auth in state AUTH_HANDSHAKE (handshake supported)                                                                                          
7|2019-07-29 20:39:21.443|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boots
trap: Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                                
7|2019-07-29 20:39:21.444|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Initializing SASL client: service name kafka, hostname 99.12.143.35, mechanisms PLAIN, provider PLAIN (builtin)                             
7|2019-07-29 20:39:21.445|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/b
ootstrap: Sending SASL PLAIN (builtin) authentication token                                                                                      
7|2019-07-29 20:39:21.445|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/bootst
rap: Send SASL frame to broker (15 bytes)                                                                                                        
7|2019-07-29 20:39:21.446|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Received SASL frame from broker (4 bytes)                                                                                                 
7|2019-07-29 20:39:21.447|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093
/bootstrap: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                               
7|2019-07-29 20:39:21.448|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boo
tstrap: Broker changed state AUTH -> UP                                                                                                          
7|2019-07-29 20:39:21.449|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/
bootstrap: Request metadata for brokers only: connected                                                                                          
7|2019-07-29 20:39:21.434|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Received SaslHandshakeResponse (v0, 13 bytes, CorrId 2, rtt 1.70ms)                                                                         
7|2019-07-29 20:39:21.452|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/b
ootstrap: Broker supported SASL mechanisms: PLAIN                                                                                                
7|2019-07-29 20:39:21.453|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Auth in state AUTH_HANDSHAKE (handshake supported)                                                                                          
7|2019-07-29 20:39:21.454|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boots
trap: Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                                
7|2019-07-29 20:39:21.451|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Sent MetadataRequest (v1, 25 bytes @ 0, CorrId 3)                                                                                         
7|2019-07-29 20:39:21.442|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Received ApiVersionResponse (v0, 120 bytes, CorrId 1, rtt 19.23ms)                                                                        
7|2019-07-29 20:39:21.454|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/b
ootstrap: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,L
Z4                                                                                                                                               
7|2019-07-29 20:39:21.458|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Auth in state APIVERSION_QUERY (handshake supported)                                                                                      
7|2019-07-29 20:39:21.459|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boo
tstrap: Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                  
7|2019-07-29 20:39:21.454|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/boot
strap: Received MetadataResponse (v1, 135 bytes, CorrId 3, rtt 3.63ms)                                                                           
7|2019-07-29 20:39:21.454|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Initializing SASL client: service name kafka, hostname 99.12.141.43, mechanisms PLAIN, provider PLAIN (builtin)                             
7|2019-07-29 20:39:21.461|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/b
ootstrap: Sending SASL PLAIN (builtin) authentication token                                                                                      
7|2019-07-29 20:39:21.462|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/bootst
rap: Send SASL frame to broker (15 bytes)                                                                                                        
7|2019-07-29 20:39:21.460|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Sent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 2)                                                                                    
7|2019-07-29 20:39:21.460|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap: ===== Received metadata: conne
cted =====                                                                                                                                       
7|2019-07-29 20:39:21.464|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap: ClusterId: , ControllerId: 0  
7|2019-07-29 20:39:21.464|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap: 5 brokers, 0 topics           
7|2019-07-29 20:39:21.465|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap:   Broker #0/5: 99.12.141.43:90
93 NodeId 2                                                                                                                                      
7|2019-07-29 20:39:21.465|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap:   Broker #1/5: 99.12.141.219:9
093 NodeId 4                                                                                                                                     
7|2019-07-29 20:39:21.463|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Received SaslHandshakeResponse (v0, 13 bytes, CorrId 2, rtt 3.59ms)                                                                       
7|2019-07-29 20:39:21.467|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/bootstrap: Broker supported SASL mechanisms: PLAIN                                                                                              
7|2019-07-29 20:39:21.468|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Auth in state AUTH_HANDSHAKE (handshake supported)                                                                                        
7|2019-07-29 20:39:21.469|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boo
tstrap: Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                              
7|2019-07-29 20:39:21.470|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Initializing SASL client: service name kafka, hostname 99.12.141.128, mechanisms PLAIN, provider PLAIN (builtin)                          
7|2019-07-29 20:39:21.471|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/bootstrap: Sending SASL PLAIN (builtin) authentication token                                                                                    
7|2019-07-29 20:39:21.473|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/boot
strap: Send SASL frame to broker (15 bytes)                                                                                                      
7|2019-07-29 20:39:21.465|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/boot
strap: NodeId changed from -1 to 2                                                                                                               
7|2019-07-29 20:39:21.475|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: N
ame changed from sasl_plaintext://99.12.141.43:9093/bootstrap to sasl_plaintext://99.12.141.43:9093/2                                            
7|2019-07-29 20:39:21.477|rdkafka#producer-1|LEADER| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: M
apped 0 partition(s) to broker                                                                                                                   
7|2019-07-29 20:39:21.478|rdkafka#producer-1|BROKER| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: Added new broker with NodeId 4          
7|2019-07-29 20:39:21.478|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap:   Broker #2/5: 99.12.141.128:9
093 NodeId 1                                                                                                                                     
7|2019-07-29 20:39:21.479|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap:   Broker #3/5: 99.12.143.35:90
93 NodeId 3                                                                                                                                      
7|2019-07-29 20:39:21.479|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/bo
otstrap: NodeId changed from -1 to 1                                                                                                             
7|2019-07-29 20:39:21.480|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1:
 Name changed from sasl_plaintext://99.12.141.128:9093/bootstrap to sasl_plaintext://99.12.141.128:9093/1                                        
7|2019-07-29 20:39:21.478|rdkafka#producer-1|BRKMAIN| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Enter 
main broker thread                                                                                                                               
7|2019-07-29 20:39:21.483|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: broker
 in state INIT connecting                                                                                                                        
7|2019-07-29 20:39:21.481|rdkafka#producer-1|LEADER| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1:
 Mapped 0 partition(s) to broker                                                                                                                 
7|2019-07-29 20:39:21.481|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/boot
strap: NodeId changed from -1 to 3                                                                                                               
7|2019-07-29 20:39:21.486|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: N
ame changed from sasl_plaintext://99.12.143.35:9093/bootstrap to sasl_plaintext://99.12.143.35:9093/3                                            
7|2019-07-29 20:39:21.486|rdkafka#producer-1|LEADER| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: M
apped 0 partition(s) to broker                                                                                                                   
7|2019-07-29 20:39:21.481|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap:   Broker #4/5: 99.12.143.120:9
093 NodeId 0                                                                                                                                     
7|2019-07-29 20:39:21.490|rdkafka#producer-1|CONTROLLERID| [thrd:main]: sasl_plaintext://99.12.143.120:9093/bootstrap: ControllerId update -1 -> 
0                                                                                                                                                
7|2019-07-29 20:39:21.491|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/bo
otstrap: NodeId changed from -1 to 0                                                                                                             
7|2019-07-29 20:39:21.493|rdkafka#producer-1|UPDATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0:
 Name changed from sasl_plaintext://99.12.143.120:9093/bootstrap to sasl_plaintext://99.12.143.120:9093/0                                        
7|2019-07-29 20:39:21.494|rdkafka#producer-1|LEADER| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0:
 Mapped 0 partition(s) to broker                                                                                                                 
7|2019-07-29 20:39:21.494|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: 
Broker changed state UP -> UPDATE                                                                                                                
7|2019-07-29 20:39:21.495|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: 
Broker changed state UPDATE -> UP                                                                                                                
7|2019-07-29 20:39:21.484|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Connec
ting to ipv4#99.12.141.219:9093 (sasl_plaintext) with socket 1208                                                                                
7|2019-07-29 20:39:21.497|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Broker c
hanged state INIT -> CONNECT                                                                                                                     
7|2019-07-29 20:39:21.488|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived SASL frame from broker (4 bytes)                                                                                                           
7|2019-07-29 20:39:21.504|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                         
7|2019-07-29 20:39:21.505|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state AUTH -> UP                                                                                                                    
7|2019-07-29 20:39:21.505|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3:
 Request metadata for brokers only: connected                                                                                                    
7|2019-07-29 20:39:21.506|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t MetadataRequest (v1, 25 bytes @ 0, CorrId 3)                                                                                                   
7|2019-07-29 20:39:21.507|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Connec
ted to ipv4#99.12.141.219:9093                                                                                                                   
7|2019-07-29 20:39:21.507|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Conn
ected (#1)                                                                                                                                       
7|2019-07-29 20:39:21.508|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Update
d enabled protocol features +ApiVersion to ApiVersion                                                                                            
7|2019-07-29 20:39:21.509|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Broker c
hanged state CONNECT -> APIVERSION_QUERY                                                                                                         
7|2019-07-29 20:39:21.511|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent ApiV
ersionRequest (v0, 25 bytes @ 0, CorrId 1)                                                                                                       
7|2019-07-29 20:39:21.509|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Rec
eived SASL frame from broker (4 bytes)                                                                                                           
7|2019-07-29 20:39:21.513|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2
: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                         
7|2019-07-29 20:39:21.513|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state AUTH -> UP                                                                                                                    
7|2019-07-29 20:39:21.514|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2:
 Request metadata for brokers only: connected                                                                                                    
7|2019-07-29 20:39:21.515|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2:
 Skipping metadata request: connected: full request already in-transit                                                                           
7|2019-07-29 20:39:21.514|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived MetadataResponse (v1, 135 bytes, CorrId 3, rtt 7.36ms)                                                                                     
7|2019-07-29 20:39:21.517|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ===== Received metadata: connected ====
=                                                                                                                                                
7|2019-07-29 20:39:21.519|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ClusterId: , ControllerId: 0           
7|2019-07-29 20:39:21.521|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: 5 brokers, 0 topics                    
7|2019-07-29 20:39:21.521|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #0/5: 99.12.141.43:9093 NodeId
 2                                                                                                                                               
7|2019-07-29 20:39:21.522|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #1/5: 99.12.141.219:9093 NodeI
d 4                                                                                                                                              
7|2019-07-29 20:39:21.522|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #2/5: 99.12.141.128:9093 NodeI
d 1                                                                                                                                              
7|2019-07-29 20:39:21.523|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #3/5: 99.12.143.35:9093 NodeId
 3                                                                                                                                               
7|2019-07-29 20:39:21.524|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #4/5: 99.12.143.120:9093 NodeI
d 0                                                                                                                                              
7|2019-07-29 20:39:21.518|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived SASL frame from broker (4 bytes)                                                                                                         
7|2019-07-29 20:39:21.525|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                       
7|2019-07-29 20:39:21.527|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state AUTH -> UP                                                                                                                  
7|2019-07-29 20:39:21.528|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/
1: Request metadata for brokers only: connected                                                                                                  
7|2019-07-29 20:39:21.529|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
ent MetadataRequest (v1, 25 bytes @ 0, CorrId 3)                                                                                                 
7|2019-07-29 20:39:21.530|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived MetadataResponse (v1, 135 bytes, CorrId 3, rtt 1.53ms)                                                                                   
7|2019-07-29 20:39:21.531|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1: ===== Received metadata: connected ===
==                                                                                                                                               
7|2019-07-29 20:39:21.531|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1: ClusterId: , ControllerId: 0          
7|2019-07-29 20:39:21.532|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1: 5 brokers, 0 topics                   
7|2019-07-29 20:39:21.532|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-29 20:39:21.532|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-29 20:39:21.533|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-29 20:39:21.534|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-29 20:39:21.537|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.128:9093/1:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-29 20:39:21.659|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
ApiVersionResponse (v0, 120 bytes, CorrId 1, rtt 147.93ms)                                                                                       
7|2019-07-29 20:39:21.661|rdkafka#producer-1|FEATURE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Update
d enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4              
7|2019-07-29 20:39:21.664|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Auth in s
tate APIVERSION_QUERY (handshake supported)                                                                                                      
7|2019-07-29 20:39:21.665|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Broker c
hanged state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                                  
7|2019-07-29 20:39:21.667|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Sasl
HandshakeRequest (v0, 28 bytes @ 0, CorrId 2)                                                                                                    
7|2019-07-29 20:39:21.680|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
SaslHandshakeResponse (v0, 13 bytes, CorrId 2, rtt 12.51ms)                                                                                      
7|2019-07-29 20:39:21.681|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Brok
er supported SASL mechanisms: PLAIN                                                                                                              
7|2019-07-29 20:39:21.682|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Auth in s
tate AUTH_HANDSHAKE (handshake supported)                                                                                                        
7|2019-07-29 20:39:21.684|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Broker c
hanged state AUTH_HANDSHAKE -> AUTH                                                                                                              
7|2019-07-29 20:39:21.686|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Initializ
ing SASL client: service name kafka, hostname 99.12.141.219, mechanisms PLAIN, provider PLAIN (builtin)                                          
7|2019-07-29 20:39:21.688|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Send
ing SASL PLAIN (builtin) authentication token                                                                                                    
7|2019-07-29 20:39:21.689|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Send SASL
 frame to broker (15 bytes)                                                                                                                      
7|2019-07-29 20:39:21.733|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
SASL frame from broker (4 bytes)                                                                                                                 
7|2019-07-29 20:39:21.734|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Rece
ived non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                               
7|2019-07-29 20:39:21.736|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Broker c
hanged state AUTH -> UP                                                                                                                          
7|2019-07-29 20:39:21.737|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Reque
st metadata for brokers only: connected                                                                                                          
7|2019-07-29 20:39:21.739|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Meta
dataRequest (v1, 25 bytes @ 0, CorrId 3)                                                                                                         
7|2019-07-29 20:39:21.745|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
MetadataResponse (v1, 135 bytes, CorrId 3, rtt 6.42ms)                                                                                           
7|2019-07-29 20:39:21.747|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ===== Received metadata: connected ===
==                                                                                                                                               
7|2019-07-29 20:39:21.750|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ClusterId: , ControllerId: 0          
7|2019-07-29 20:39:21.751|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: 5 brokers, 0 topics                   
7|2019-07-29 20:39:21.753|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-29 20:39:21.756|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-29 20:39:21.757|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-29 20:39:21.758|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-29 20:39:21.760|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
>                                                                                                                                                
> ------------------------------------------                                                                                                     
7|2019-07-29 20:40:08.369|rdkafka#producer-1|METADATA| [thrd:main]: Requesting metadata for 1/1 topics: refresh unavailable topics               
7|2019-07-29 20:40:08.369|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: Request metadata for 1 topic(s): refres
h unavailable topics                                                                                                                             
7|2019-07-29 20:40:08.372|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t MetadataRequest (v1, 58 bytes @ 0, CorrId 4)                                                                                                   
7|2019-07-29 20:40:08.381|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived MetadataResponse (v1, 239 bytes, CorrId 4, rtt 9.20ms)                                                                                     
7|2019-07-29 20:40:08.384|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ===== Received metadata (for 1 requeste
d topics): refresh unavailable topics =====                                                                                                      
7|2019-07-29 20:40:08.386|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ClusterId: , ControllerId: 0           
7|2019-07-29 20:40:08.387|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: 5 brokers, 1 topics                    
7|2019-07-29 20:40:08.388|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #0/5: 99.12.141.43:9093 NodeId
 2                                                                                                                                               
7|2019-07-29 20:40:08.389|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #1/5: 99.12.141.219:9093 NodeI
d 4                                                                                                                                              
7|2019-07-29 20:40:08.391|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #2/5: 99.12.141.128:9093 NodeI
d 1                                                                                                                                              
7|2019-07-29 20:40:08.392|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #3/5: 99.12.143.35:9093 NodeId
 3                                                                                                                                               
7|2019-07-29 20:40:08.394|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #4/5: 99.12.143.120:9093 NodeI
d 0                                                                                                                                              
7|2019-07-29 20:40:08.394|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog_
FLM_SZ with 2 partitions                                                                                                                         
7|2019-07-29 20:40:08.395|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-29 20:40:08.396|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-29 20:40:08.398|rdkafka#producer-1|TOPBRK| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: T
opic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ [1]: joining broker (rktp 0525AAA0)                                                                         
7|2019-07-29 20:40:08.396|rdkafka#producer-1|TOPBRK| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Topic M
_LC12_L_YSTWEB_ErrorLog_FLM_SZ [0]: joining broker (rktp 0525A6E0)                                                                               
7|2019-07-29 20:40:08.405|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Prod
uceRequest (v2, 349 bytes @ 0, CorrId 4)                                                                                                         
7|2019-07-29 20:40:08.451|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received

it blocked here...

Checklist

Please provide the following information:

  • librdkafka version 0.11.6
  • Operating system: windows7
    Thanks!
@edenhill
Copy link
Contributor

The log is cut short just as it sends the produce product request, and we can see that it receives something but then the log ends.

@better2being
Copy link
Author

better2being commented Jul 30, 2019 •
edited by edenhill
Loading

The follow-up log is like this.

It‘s a fact that it receives something like response. but i can't the message find in kafka, the program is also blocked, with log outputing
I'm really confused why it cannot write message to kafka?

7|2019-07-30 09:24:01.682|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Sen
t MetadataRequest (v1, 58 bytes @ 0, CorrId 4)                                                                                                   
7|2019-07-30 09:24:01.686|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Rec
eived MetadataResponse (v1, 239 bytes, CorrId 4, rtt 3.58ms)                                                                                     
7|2019-07-30 09:24:01.687|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2: ===== Received metadata (for 1 requeste
d topics): periodic refresh =====                                                                                                                
7|2019-07-30 09:24:01.689|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2: ClusterId: , ControllerId: 0           
7|2019-07-30 09:24:01.690|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2: 5 brokers, 1 topics                    
7|2019-07-30 09:24:01.691|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Broker #0/5: 99.12.141.43:9093 NodeId
 2                                                                                                                                               
7|2019-07-30 09:24:01.692|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Broker #1/5: 99.12.141.219:9093 NodeI
d 4                                                                                                                                              
7|2019-07-30 09:24:01.693|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Broker #2/5: 99.12.141.128:9093 NodeI
d 1                                                                                                                                              
7|2019-07-30 09:24:01.695|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Broker #3/5: 99.12.143.35:9093 NodeId
 3                                                                                                                                               
7|2019-07-30 09:24:01.696|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Broker #4/5: 99.12.143.120:9093 NodeI
d 0                                                                                                                                              
7|2019-07-30 09:24:01.697|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.43:9093/2:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog_
FLM_SZ with 2 partitions                                                                                                                         
7|2019-07-30 09:24:01.698|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:24:01.700|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:29:01.691|rdkafka#producer-1|METADATA| [thrd:main]: Requesting metadata for 1/1 topics: periodic refresh                         
7|2019-07-30 09:29:01.692|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: Request metadata for 1 topic(s): perio
dic refresh                                                                                                                                      
7|2019-07-30 09:29:01.693|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: S
ent MetadataRequest (v1, 58 bytes @ 0, CorrId 4)                                                                                                 
7|2019-07-30 09:29:01.695|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: R
eceived MetadataResponse (v1, 239 bytes, CorrId 4, rtt 1.86ms)                                                                                   
7|2019-07-30 09:29:01.696|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: ===== Received metadata (for 1 request
ed topics): periodic refresh =====                                                                                                               
7|2019-07-30 09:29:01.696|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: ClusterId: , ControllerId: 0          
7|2019-07-30 09:29:01.697|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: 5 brokers, 1 topics                   
7|2019-07-30 09:29:01.697|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-30 09:29:01.698|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-30 09:29:01.699|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-30 09:29:01.699|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-30 09:29:01.700|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-30 09:29:01.701|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog
_FLM_SZ with 2 partitions                                                                                                                        
7|2019-07-30 09:29:01.703|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:29:01.703|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:29:02.073|rdkafka#producer-1|BROKERFAIL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:909
3/1: failed: err: Local: Broker transport failure: (errno: No error)                                                                             
7|2019-07-30 09:29:02.075|rdkafka#producer-1|FAIL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: D
isconnected (after 600217ms in state UP)                                                                                                         
7|2019-07-30 09:29:02.077|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state UP -> DOWN                                                                                                                  
7|2019-07-30 09:29:02.078|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: Requesting metadata for 1/1 topics: 
broker down                                                                                                                                      
7|2019-07-30 09:29:02.079|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.219:9093/
4: Request metadata for 1 topic(s): broker down                                                                                                  
7|2019-07-30 09:29:02.079|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: broker in state DOWN connecting                                                                                                                
7|2019-07-30 09:29:02.080|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: Connecting to ipv4#99.12.141.128:9093 (sasl_plaintext) with socket 1264                                                                        
7|2019-07-30 09:29:02.081|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state DOWN -> CONNECT                                                                                                             
7|2019-07-30 09:29:02.079|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Meta
dataRequest (v1, 58 bytes @ 0, CorrId 5)                                                                                                         
7|2019-07-30 09:29:02.083|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
MetadataResponse (v1, 239 bytes, CorrId 5, rtt 3.12ms)                                                                                           
7|2019-07-30 09:29:02.083|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ===== Received metadata (for 1 request
ed topics): broker down =====                                                                                                                    
7|2019-07-30 09:29:02.083|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ClusterId: , ControllerId: 0          
7|2019-07-30 09:29:02.084|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: 5 brokers, 1 topics                   
7|2019-07-30 09:29:02.084|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-30 09:29:02.085|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-30 09:29:02.085|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-30 09:29:02.086|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-30 09:29:02.087|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-30 09:29:02.087|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog
_FLM_SZ with 2 partitions                                                                                                                        
7|2019-07-30 09:29:02.088|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:29:02.089|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:29:02.092|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: Connected to ipv4#99.12.141.128:9093                                                                                                           
7|2019-07-30 09:29:02.092|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Connected (#2)                                                                                                                               
7|2019-07-30 09:29:02.093|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state CONNECT -> APIVERSION_QUERY                                                                                                 
7|2019-07-30 09:29:02.094|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
ent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 3)                                                                                               
7|2019-07-30 09:29:02.101|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived ApiVersionResponse (v0, 120 bytes, CorrId 3, rtt 7.01ms)                                                                                 
7|2019-07-30 09:29:02.102|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: A
uth in state APIVERSION_QUERY (handshake supported)                                                                                              
7|2019-07-30 09:29:02.104|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                          
7|2019-07-30 09:29:02.106|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
ent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 4)                                                                                            
7|2019-07-30 09:29:02.117|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived SaslHandshakeResponse (v0, 13 bytes, CorrId 4, rtt 11.19ms)                                                                              
7|2019-07-30 09:29:02.118|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Broker supported SASL mechanisms: PLAIN                                                                                                      
7|2019-07-30 09:29:02.119|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: A
uth in state AUTH_HANDSHAKE (handshake supported)                                                                                                
7|2019-07-30 09:29:02.120|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                                      
7|2019-07-30 09:29:02.121|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: I
nitializing SASL client: service name kafka, hostname 99.12.141.128, mechanisms PLAIN, provider PLAIN (builtin)                                  
7|2019-07-30 09:29:02.122|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Sending SASL PLAIN (builtin) authentication token                                                                                            
7|2019-07-30 09:29:02.123|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
end SASL frame to broker (15 bytes)                                                                                                              
7|2019-07-30 09:29:02.167|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived SASL frame from broker (4 bytes)                                                                                                         
7|2019-07-30 09:29:02.169|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                       
7|2019-07-30 09:29:02.169|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state AUTH -> UP                                                                                                                  
7|2019-07-30 09:29:02.171|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: Skipping metadata refresh of 1 topic
(s): connected: already being requested                                                                                                          
7|2019-07-30 09:29:04.825|rdkafka#producer-1|BROKERFAIL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/
3: failed: err: Local: Broker transport failure: (errno: No error)                                                                               
7|2019-07-30 09:29:04.829|rdkafka#producer-1|FAIL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Dis
connected (after 602872ms in state UP)                                                                                                           
7|2019-07-30 09:29:04.830|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state UP -> DOWN                                                                                                                    
7|2019-07-30 09:29:04.833|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: Requesting metadata for 1/1 topics: b
roker down                                                                                                                                       
7|2019-07-30 09:29:04.835|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.141.219:9093/4
: Request metadata for 1 topic(s): broker down                                                                                                   
7|2019-07-30 09:29:04.837|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: 
broker in state DOWN connecting                                                                                                                  
7|2019-07-30 09:29:04.838|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Meta
dataRequest (v1, 58 bytes @ 0, CorrId 6)                                                                                                         
7|2019-07-30 09:29:04.840|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: 
Connecting to ipv4#99.12.143.35:9093 (sasl_plaintext) with socket 1048                                                                           
7|2019-07-30 09:29:04.845|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state DOWN -> CONNECT                                                                                                               
7|2019-07-30 09:29:04.847|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: 
Connected to ipv4#99.12.143.35:9093                                                                                                              
7|2019-07-30 09:29:04.850|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Connected (#2)                                                                                                                                 
7|2019-07-30 09:29:04.852|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state CONNECT -> APIVERSION_QUERY                                                                                                   
7|2019-07-30 09:29:04.856|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t ApiVersionRequest (v0, 25 bytes @ 0, CorrId 5)                                                                                                 
7|2019-07-30 09:29:04.858|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived ApiVersionResponse (v0, 120 bytes, CorrId 5, rtt 2.27ms)                                                                                   
7|2019-07-30 09:29:04.859|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Aut
h in state APIVERSION_QUERY (handshake supported)                                                                                                
7|2019-07-30 09:29:04.861|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                            
7|2019-07-30 09:29:04.864|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 6)                                                                                              
7|2019-07-30 09:29:04.866|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived SaslHandshakeResponse (v0, 13 bytes, CorrId 6, rtt 1.77ms)                                                                                 
7|2019-07-30 09:29:04.867|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Broker supported SASL mechanisms: PLAIN                                                                                                        
7|2019-07-30 09:29:04.868|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Aut
h in state AUTH_HANDSHAKE (handshake supported)                                                                                                  
7|2019-07-30 09:29:04.870|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state AUTH_HANDSHAKE -> AUTH                                                                                                        
7|2019-07-30 09:29:04.870|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Ini
tializing SASL client: service name kafka, hostname 99.12.143.35, mechanisms PLAIN, provider PLAIN (builtin)                                     
7|2019-07-30 09:29:04.872|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Sending SASL PLAIN (builtin) authentication token                                                                                              
7|2019-07-30 09:29:04.873|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
d SASL frame to broker (15 bytes)                                                                                                                
7|2019-07-30 09:29:04.915|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived SASL frame from broker (4 bytes)                                                                                                           
7|2019-07-30 09:29:04.917|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                         
7|2019-07-30 09:29:04.917|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Br
oker changed state AUTH -> UP                                                                                                                    
7|2019-07-30 09:29:04.918|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: Skipping metadata refresh of 1 topic(
s): connected: already being requested                                                                                                           
7|2019-07-30 09:29:04.965|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
MetadataResponse (v1, 239 bytes, CorrId 6, rtt 127.13ms)                                                                                         
7|2019-07-30 09:29:04.966|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ===== Received metadata (for 1 request
ed topics): broker down =====                                                                                                                    
7|2019-07-30 09:29:04.967|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ClusterId: , ControllerId: 0          
7|2019-07-30 09:29:04.968|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: 5 brokers, 1 topics                   
7|2019-07-30 09:29:04.969|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-30 09:29:04.971|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-30 09:29:04.972|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-30 09:29:04.974|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-30 09:29:04.975|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-30 09:29:04.977|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog
_FLM_SZ with 2 partitions                                                                                                                        
7|2019-07-30 09:29:04.978|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:29:04.980|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:34:01.684|rdkafka#producer-1|BROKERFAIL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/
2: failed: err: Local: Broker transport failure: (errno: No error)                                                                               
7|2019-07-30 09:34:01.684|rdkafka#producer-1|FAIL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Dis
connected (after 899838ms in state UP)                                                                                                           
7|2019-07-30 09:34:01.685|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state UP -> DOWN                                                                                                                    
7|2019-07-30 09:34:01.685|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: Requesting metadata for 1/1 topics: b
roker down                                                                                                                                       
7|2019-07-30 09:34:01.686|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.219:9093/4
: Request metadata for 1 topic(s): broker down                                                                                                   
7|2019-07-30 09:34:01.686|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: 
broker in state DOWN connecting                                                                                                                  
7|2019-07-30 09:34:01.687|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: 
Connecting to ipv4#99.12.141.43:9093 (sasl_plaintext) with socket 1084                                                                           
7|2019-07-30 09:34:01.688|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state DOWN -> CONNECT                                                                                                               
7|2019-07-30 09:34:01.689|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: 
Connected to ipv4#99.12.141.43:9093                                                                                                              
7|2019-07-30 09:34:01.686|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Sent Meta
dataRequest (v1, 58 bytes @ 0, CorrId 7)                                                                                                         
7|2019-07-30 09:34:01.693|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2
: Connected (#2)                                                                                                                                 
7|2019-07-30 09:34:01.695|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state CONNECT -> APIVERSION_QUERY                                                                                                   
7|2019-07-30 09:34:01.698|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Sen
t ApiVersionRequest (v0, 25 bytes @ 0, CorrId 5)                                                                                                 
7|2019-07-30 09:34:01.698|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.219:9093/4]: sasl_plaintext://99.12.141.219:9093/4: Received 
MetadataResponse (v1, 239 bytes, CorrId 7, rtt 11.70ms)                                                                                          
7|2019-07-30 09:34:01.700|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ===== Received metadata (for 1 request
ed topics): broker down =====                                                                                                                    
7|2019-07-30 09:34:01.700|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: ClusterId: , ControllerId: 0          
7|2019-07-30 09:34:01.701|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4: 5 brokers, 1 topics                   
7|2019-07-30 09:34:01.701|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-30 09:34:01.701|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-30 09:34:01.702|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-30 09:34:01.703|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-30 09:34:01.703|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-30 09:34:01.704|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.141.219:9093/4:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog
_FLM_SZ with 2 partitions                                                                                                                        
7|2019-07-30 09:34:01.706|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:34:01.706|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:34:01.710|rdkafka#producer-1|METADATA| [thrd:main]: Requesting metadata for 1/1 topics: periodic refresh                         
7|2019-07-30 09:34:01.710|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: Request metadata for 1 topic(s): perio
dic refresh                                                                                                                                      
7|2019-07-30 09:34:01.711|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: S
ent MetadataRequest (v1, 58 bytes @ 0, CorrId 5)                                                                                                 
7|2019-07-30 09:34:01.699|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Rec
eived ApiVersionResponse (v0, 120 bytes, CorrId 5, rtt 1.37ms)                                                                                   
7|2019-07-30 09:34:01.714|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Aut
h in state APIVERSION_QUERY (handshake supported)                                                                                                
7|2019-07-30 09:34:01.715|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                            
7|2019-07-30 09:34:01.714|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.120:9093/bootstrap]: sasl_plaintext://99.12.143.120:9093/0: R
eceived MetadataResponse (v1, 239 bytes, CorrId 5, rtt 2.48ms)                                                                                   
7|2019-07-30 09:34:01.717|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: ===== Received metadata (for 1 request
ed topics): periodic refresh =====                                                                                                               
7|2019-07-30 09:34:01.718|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: ClusterId: , ControllerId: 0          
7|2019-07-30 09:34:01.718|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0: 5 brokers, 1 topics                   
7|2019-07-30 09:34:01.718|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #0/5: 99.12.141.43:9093 NodeI
d 2                                                                                                                                              
7|2019-07-30 09:34:01.719|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #1/5: 99.12.141.219:9093 Node
Id 4                                                                                                                                             
7|2019-07-30 09:34:01.719|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #2/5: 99.12.141.128:9093 Node
Id 1                                                                                                                                             
7|2019-07-30 09:34:01.720|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #3/5: 99.12.143.35:9093 NodeI
d 3                                                                                                                                              
7|2019-07-30 09:34:01.720|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Broker #4/5: 99.12.143.120:9093 Node
Id 0                                                                                                                                             
7|2019-07-30 09:34:01.721|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.120:9093/0:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog
_FLM_SZ with 2 partitions                                                                                                                        
7|2019-07-30 09:34:01.721|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:34:01.726|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:34:01.715|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Sen
t SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 6)                                                                                              
7|2019-07-30 09:34:01.730|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Rec
eived SaslHandshakeResponse (v0, 13 bytes, CorrId 6, rtt 14.50ms)                                                                                
7|2019-07-30 09:34:01.732|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2
: Broker supported SASL mechanisms: PLAIN                                                                                                        
7|2019-07-30 09:34:01.733|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Aut
h in state AUTH_HANDSHAKE (handshake supported)                                                                                                  
7|2019-07-30 09:34:01.734|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state AUTH_HANDSHAKE -> AUTH                                                                                                        
7|2019-07-30 09:34:01.734|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Ini
tializing SASL client: service name kafka, hostname 99.12.141.43, mechanisms PLAIN, provider PLAIN (builtin)                                     
7|2019-07-30 09:34:01.735|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2
: Sending SASL PLAIN (builtin) authentication token                                                                                              
7|2019-07-30 09:34:01.736|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Sen
d SASL frame to broker (15 bytes)                                                                                                                
7|2019-07-30 09:34:01.778|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Rec
eived SASL frame from broker (4 bytes)                                                                                                           
7|2019-07-30 09:34:01.779|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2
: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                         
7|2019-07-30 09:34:01.782|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: sasl_plaintext://99.12.141.43:9093/2: Br
oker changed state AUTH -> UP                                                                                                                    
7|2019-07-30 09:34:01.786|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.43:9093/bootstrap]: Skipping metadata refresh of 1 topic(
s): connected: already being requested                                                                                                           
7|2019-07-30 09:39:01.721|rdkafka#producer-1|METADATA| [thrd:main]: Requesting metadata for 1/1 topics: periodic refresh                         
7|2019-07-30 09:39:01.722|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: Request metadata for 1 topic(s): period
ic refresh                                                                                                                                       
7|2019-07-30 09:39:01.726|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t MetadataRequest (v1, 58 bytes @ 0, CorrId 7)                                                                                                   
7|2019-07-30 09:39:01.840|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived MetadataResponse (v1, 239 bytes, CorrId 7, rtt 114.10ms)                                                                                   
7|2019-07-30 09:39:01.843|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ===== Received metadata (for 1 requeste
d topics): periodic refresh =====                                                                                                                
7|2019-07-30 09:39:01.847|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ClusterId: , ControllerId: 0           
7|2019-07-30 09:39:01.848|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: 5 brokers, 1 topics                    
7|2019-07-30 09:39:01.850|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #0/5: 99.12.141.43:9093 NodeId
 2                                                                                                                                               
7|2019-07-30 09:39:01.852|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #1/5: 99.12.141.219:9093 NodeI
d 4                                                                                                                                              
7|2019-07-30 09:39:01.853|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #2/5: 99.12.141.128:9093 NodeI
d 1                                                                                                                                              
7|2019-07-30 09:39:01.857|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #3/5: 99.12.143.35:9093 NodeId
 3                                                                                                                                               
7|2019-07-30 09:39:01.859|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #4/5: 99.12.143.120:9093 NodeI
d 0                                                                                                                                              
7|2019-07-30 09:39:01.861|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog_
FLM_SZ with 2 partitions                                                                                                                         
7|2019-07-30 09:39:01.863|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:39:01.864|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:39:02.168|rdkafka#producer-1|BROKERFAIL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:909
3/1: failed: err: Local: Broker transport failure: (errno: No error)                                                                             
7|2019-07-30 09:39:02.169|rdkafka#producer-1|FAIL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: D
isconnected (after 599978ms in state UP)                                                                                                         
7|2019-07-30 09:39:02.169|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state UP -> DOWN                                                                                                                  
7|2019-07-30 09:39:02.170|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: Requesting metadata for 1/1 topics: 
broker down                                                                                                                                      
7|2019-07-30 09:39:02.171|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3
: Request metadata for 1 topic(s): broker down                                                                                                   
7|2019-07-30 09:39:02.172|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: broker in state DOWN connecting                                                                                                                
7|2019-07-30 09:39:02.172|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Sen
t MetadataRequest (v1, 58 bytes @ 0, CorrId 8)                                                                                                   
7|2019-07-30 09:39:02.172|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: Connecting to ipv4#99.12.141.128:9093 (sasl_plaintext) with socket 1264                                                                        
7|2019-07-30 09:39:02.174|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state DOWN -> CONNECT                                                                                                             
7|2019-07-30 09:39:02.175|rdkafka#producer-1|CONNECT| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1
: Connected to ipv4#99.12.141.128:9093                                                                                                           
7|2019-07-30 09:39:02.176|rdkafka#producer-1|CONNECTED| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Connected (#3)                                                                                                                               
7|2019-07-30 09:39:02.176|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state CONNECT -> APIVERSION_QUERY                                                                                                 
7|2019-07-30 09:39:02.174|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.143.35:9093/bootstrap]: sasl_plaintext://99.12.143.35:9093/3: Rec
eived MetadataResponse (v1, 239 bytes, CorrId 8, rtt 2.19ms)                                                                                     
7|2019-07-30 09:39:02.178|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ===== Received metadata (for 1 requeste
d topics): broker down =====                                                                                                                     
7|2019-07-30 09:39:02.179|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: ClusterId: , ControllerId: 0           
7|2019-07-30 09:39:02.179|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3: 5 brokers, 1 topics                    
7|2019-07-30 09:39:02.180|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #0/5: 99.12.141.43:9093 NodeId
 2                                                                                                                                               
7|2019-07-30 09:39:02.180|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #1/5: 99.12.141.219:9093 NodeI
d 4                                                                                                                                              
7|2019-07-30 09:39:02.181|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #2/5: 99.12.141.128:9093 NodeI
d 1                                                                                                                                              
7|2019-07-30 09:39:02.182|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #3/5: 99.12.143.35:9093 NodeId
 3                                                                                                                                               
7|2019-07-30 09:39:02.182|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Broker #4/5: 99.12.143.120:9093 NodeI
d 0                                                                                                                                              
7|2019-07-30 09:39:02.183|rdkafka#producer-1|METADATA| [thrd:main]: sasl_plaintext://99.12.143.35:9093/3:   Topic #0/1: M_LC12_L_YSTWEB_ErrorLog_
FLM_SZ with 2 partitions                                                                                                                         
7|2019-07-30 09:39:02.183|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 0 Leader 4                 
7|2019-07-30 09:39:02.184|rdkafka#producer-1|METADATA| [thrd:main]:   Topic M_LC12_L_YSTWEB_ErrorLog_FLM_SZ partition 1 Leader 3                 
7|2019-07-30 09:39:02.177|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
ent ApiVersionRequest (v0, 25 bytes @ 0, CorrId 5)                                                                                               
7|2019-07-30 09:39:02.186|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived ApiVersionResponse (v0, 120 bytes, CorrId 5, rtt 8.99ms)                                                                                 
7|2019-07-30 09:39:02.187|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: A
uth in state APIVERSION_QUERY (handshake supported)                                                                                              
7|2019-07-30 09:39:02.187|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state APIVERSION_QUERY -> AUTH_HANDSHAKE                                                                                          
7|2019-07-30 09:39:02.188|rdkafka#producer-1|SEND| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
ent SaslHandshakeRequest (v0, 28 bytes @ 0, CorrId 6)                                                                                            
7|2019-07-30 09:39:02.191|rdkafka#producer-1|RECV| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived SaslHandshakeResponse (v0, 13 bytes, CorrId 6, rtt 2.93ms)                                                                               
7|2019-07-30 09:39:02.191|rdkafka#producer-1|SASLMECHS| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Broker supported SASL mechanisms: PLAIN                                                                                                      
7|2019-07-30 09:39:02.192|rdkafka#producer-1|AUTH| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: A
uth in state AUTH_HANDSHAKE (handshake supported)                                                                                                
7|2019-07-30 09:39:02.192|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state AUTH_HANDSHAKE -> AUTH                                                                                                      
7|2019-07-30 09:39:02.193|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: I
nitializing SASL client: service name kafka, hostname 99.12.141.128, mechanisms PLAIN, provider PLAIN (builtin)                                  
7|2019-07-30 09:39:02.193|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Sending SASL PLAIN (builtin) authentication token                                                                                            
7|2019-07-30 09:39:02.194|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: S
end SASL frame to broker (15 bytes)                                                                                                              
7|2019-07-30 09:39:02.236|rdkafka#producer-1|SASL| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: R
eceived SASL frame from broker (4 bytes)                                                                                                         
7|2019-07-30 09:39:02.239|rdkafka#producer-1|SASLPLAIN| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093
/1: Received non-empty SASL PLAIN (builtin) response from broker (4 bytes)                                                                       
7|2019-07-30 09:39:02.242|rdkafka#producer-1|STATE| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: sasl_plaintext://99.12.141.128:9093/1: 
Broker changed state AUTH -> UP                                                                                                                  
7|2019-07-30 09:39:02.244|rdkafka#producer-1|METADATA| [thrd:sasl_plaintext://99.12.141.128:9093/bootstrap]: Skipping metadata refresh of 1 topic
(s): connected: already being requested

@edenhill
Copy link
Contributor

There is no ProduceRequest in the latest log, this means one of the following:

  • the log is cut short
  • you are not produce()ing messages
  • the partition you are producing to has a leader broker that is not available

Setting the "debug" property to "broker,msg,metadata,topic" should provide us enough information to troubleshoot the last option

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@edenhill @better2being