NIFI-12952 Add Amazon MSK Connection Service and NAR #9896
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
NIFI-12952 Adds an Amazon MSK implementation of the Kafka Connection Service supporting IAM Access Control based on the AWS MSK IAM library.
The implementation extends the standard
Kafka3ConnectionService
and modifies theSASL Mechanism
property to include and default to AWS MSK IAM. The implementation also adds the optionalAWS Profile
property.The service class builds on existing SASL handling in the
nifi-kafka-shared
library where theAwsMskIamLoginConfigProvider
builds the required SASL configuration.The implementation is packaged in a
nifi-kafka-service-aws-nar
, apart from thenifi-kafka-3-service-nar
as the Amazon MSK class has a number of additional transitive dependencies.Additional changes include adjusting the parent NAR of the
nifi-kafka-service-api-nar
tonifi-standard-shared-nar
in order to avoid including duplicate copies of standard libraries in the service NAR bundles.Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking
Pull Request Tracking
NIFI-00000
NIFI-00000
Pull Request Formatting
main
branchVerification
Please indicate the verification steps performed prior to pull request creation.
Build
mvn clean install -P contrib-check
Licensing
LICENSE
andNOTICE
filesDocumentation