Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pulsar support for Apache Avro library as published by Apache #13096

Open
aditya7k opened this issue Dec 2, 2021 · 4 comments
Open

Pulsar support for Apache Avro library as published by Apache #13096

aditya7k opened this issue Dec 2, 2021 · 4 comments
Labels
lifecycle/stale Stale type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages

Comments

@aditya7k
Copy link

aditya7k commented Dec 2, 2021

Is your enhancement request related to a problem? Please describe.

We have a requirement to use both Kafka and Pulsar with Apache Avro Schemas. This is not possible currently as Pulsar uses it's own shaded (masked) version of apache avro implementation, which looks identical to Apache Avro.

Describe the solution you'd like

The enhancement is for Pulsar to work directly with Apache's Avro implementation.

Describe alternatives you've considered

Currently we are defining Schema's using Apache Avro Generic Record and then writing conversions to work with Pulsar's shaded version.

Additional context

Add any other context or screenshots about the feature request here.

We have written converters to allow schemas which serialize to org.apache.avro.generic.GenericRecord to allow serialization to
org.apache.pulsar.shade.org.apache.avro.generic.GenericRecord.

@aditya7k aditya7k added the type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages label Dec 2, 2021
@sijie
Copy link
Member

sijie commented Dec 2, 2021

@adityaIndexlabs if you use pulsar-client-original library, you will not use the shaded library.

@sollecitom
Copy link

sollecitom commented Dec 13, 2021

@sijie does pulsar-client-original have a org.apache.pulsar.client.api.Schema<org.apache.avro.generic.GenericRecord>? That's what's needed to support native Avro records.

@github-actions
Copy link

The issue had no activity for 30 days, mark with Stale label.

@github-actions
Copy link

The issue had no activity for 30 days, mark with Stale label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/stale Stale type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

No branches or pull requests

3 participants