-
Notifications
You must be signed in to change notification settings - Fork 14.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Pinecone Provider #35094
Merged
Merged
Add Pinecone Provider #35094
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
utkarsharma2
commented
Oct 20, 2023
c51a1b4
to
fe6d728
Compare
fe6d728
to
c17f994
Compare
josh-fell
reviewed
Oct 30, 2023
fead816
to
ffa9917
Compare
pankajastro
reviewed
Nov 2, 2023
pankajastro
reviewed
Nov 2, 2023
Co-authored-by: Josh Fell <[email protected]>
259b065
to
6de02a5
Compare
60 tasks
romsharon98
pushed a commit
to romsharon98/airflow
that referenced
this pull request
Nov 10, 2023
This PR is part of our larger effort to add first-class integrations to support LLMOps that was presented at Airflow Summit. In this PR we are adding Pinecone Provider. Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. The primary objective of this Provider is to present users with an alternative Vector Database. --------- Co-authored-by: Josh Fell <[email protected]> Co-authored-by: Hussein Awala <[email protected]> Co-authored-by: Pankaj Singh <[email protected]> Co-authored-by: Pankaj <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
area:dev-tools
area:providers
changelog:skip
Changes that should be skipped from the changelog (CI, tests, etc..)
kind:documentation
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR is part of our larger effort to add first-class integrations to support LLMOps that was presented at Airflow Summit.
In this PR we are adding Pinecone Provider. Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. The primary objective of this Provider is to present users with an alternative Vector Database.
Example DAG:
The PineconeIngestOperator can accept either a list vector or a callable returning a list vector.
Email Discussion related to the effort can be found here - https://lists.apache.org/thread/0d669fmy4hn29h5c0wj0ottdskd77ktp