Add ordering key in GCP PubSub operator PubSubPublishMessageOperator #39940
Labels
area:providers
good first issue
kind:feature
Feature Requests
provider:google
Google (including GCP) related issues
Description
Currently, the
PubSubPublishMessageOperator
in the Google Cloud Platform (GCP) integration for Apache Airflow does not allow specifying an ordering key for published messages. The ordering key is a feature provided by Cloud Pub/Sub that allows messages to be delivered in the order they were published within a single ordering key.Use case/motivation
There are several use cases where maintaining the order of published messages is crucial, such as:
By adding support for ordering keys in the
PubSubPublishMessageOperator
, Airflow users would be able to leverage this Cloud Pub/Sub feature and ensure that their published messages are delivered in the desired order, enabling more robust and reliable data processing pipelines.Related issues
None that I'm aware of.
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: