This repository contains a reference architecture for building Event Driven Architectures (EDA) with Open Source technologies such as Kubernetes and Apache Kafka on Amazon Web Services (AWS). The architecture is based on containers, showcases several integration patterns and leverages open source Kafka connectors such as the Amazon EventBridge Sink connector to easily integrate with native AWS serverless services.
The architecture is based on an artificial domain called Managed Care Plan. The Managed Care Plan is a platform that allows:
- Care providers to manage their profiles and share their availability
- Patients to create a patient profile and search & book care provider availability (bookings).
An API for providers to manage their profiles and availability. The service also offers the possibility for external systems to book the availability via an asynchronous request-reply channel.
An API for patients to manage their profiles and to search & book the availabilities that the providers created.
A Kafka Streams application to filter out bookings that are covered by insurance.
A service to handle bookings that are scheduled 'on-site'.
Below you can find a visualization of the end-to-end application flow and the components involved.
- Providers can manage their profiles and availability via the Provider Schedule Service. The data will be stored in a PostgreSQL table.
- The availability will be published as an event to the
provider.availabilitytopic including provider data (Event Carried State Transfer) - The Care Plan service subscribes to the previously mentioned
provider.availabilitytopic and saves the events in its own database. - The Care Plan service allows patients to search through the provider availabilities in an optimized way and to create bookings for those availabilities. The booking data will be stored in a PostgreSQL table.
- When a booking is created the Care Plan Service sends a command message via the
provider.availability.booking.requestschannel to instruct the Provider Schedule Service to mark this availability as booked. - The Provider Schedule Service processes the booking requests and sends either a confirmation or rejection via the reply channel.
- Upon successful confirmation (or later cancellation) the Care Plan Service publishes a booking event to the
careplan.bookingstopic - The Insurance Processor is a Kafka Streams application that will filter only for bookings that the insurance will cover
- The EventBridge Kafka Sink Connector forwards all events to Amazon EventBridge for advanced routing capabilities
- An EventBridge rule is triggered when bookings will be held "on-site" and an AWS Lambda function will do the processing.
This option is based on the streaming blueprint of the Data on EKS project - a tool for building AWS managed and self-managed scalable data platform on Amazon EKS. The infrastructure will be deployed via Terraform and the application images via Amazon ECR and kubectl. To deploy the full version with all components to your AWS account please refer to the deployment instructions.
For testing purposes we have provided a local setup to get the application running locally via Docker Compose. This will spin up all the core component without any direct AWS Account interaction. The setup leverages Localstack to mock out the interaction with Amazon Eventbridge and other Serverless components such as AWS Lambda and SQS are not used in this setup. Please follow the local setup instructions to get started.
See CONTRIBUTING for more information.
This library is licensed under the MIT-0 License. See the LICENSE file.