S01E09: Testing RabbitMQ Resiliency with Chaos Mesh

[gerhard]

TGIR S01E09: Testing RabbitMQ Resiliency with Chaos Mesh

• Proposed via rabbitmq/tgir#19
• Hosted by @corodotdev & @gerhardlazu
• Published on: 2020-12-31
• Video: https://www.youtube.com/watch?v=y2HAJBiXsw0

How does RabbitMQ handle network latency?

What about a clean network partition?

And a partial network partition, or Byzantine failure?

We have at our disposal a wide variety of tooling for the Kubernetes infrastructure that will let us make new discoveries about the behaviour of RabbitMQ.

In this episode, we give you all the tools to set you up to make these discoveries yourself, and show you some of the interesting behaviours that we have discovered.

Closes #19

[zhouqiang-cl]

@gerhard hi, Gerhard, I am Qiang Zhou, a maintainer of Chaos Mesh, we are very glad you using Chaos Mesh to test rabbitmq. Can I invite you to share your experience in some talk such as Chaos Mesh monthly meeting?
Thank you Gerhard.

[gerhard]

Hi @zhouqiang-cl & thanks for reaching out 🙂

That's an excellent idea! I will join only if @coro joins as well. Are you up for it @coro? The next meeting is on the 28th of January according to https://github.com/chaos-mesh/chaos-mesh#community-meeting

Thinking longer-term, would you be interested @coro in putting together a canonical set of Chaos Mesh experiments that any RabbitMQ user can run in their environment? The simplest thing may be to add them to https://github.com/rabbitmq/cluster-operator/tree/main/docs/examples, but https://github.com/rabbitmq/chaos-mesh could also work.

Another thing that caught my eye is the Chaos Mesh Data Source for Grafana. That in itself sounds like a great future TGIR episode to me 🤓

I appreciate you kicking off this conversation @zhouqiang-cl, looking forward to where we take it next 😉

[coro]

Hello @zhouqiang-cl & to echo what @gerhard said, thank you for reaching out to us! We had a very positive experience working with Chaos Mesh and of course we'd love to come to your community meeting. As for further collaboration I would be interested in helping out. I think there are some limitations that might hinder a canonical set of RabbitMQ chaos events, that I'm happy to raise in the meeting, but overall I like the idea!

[zhouqiang-cl]

@gerhard @coro aha, thank you for your quick reply. Did your guys have slack or where I can contact you directly ❤️. Some of our team members will also want to join the meeting

[gerhard]

I've sent you an email Zhou, let me know if you didn't get it (remember to check spam first).

[gerhard]