Griptape
Add OllamaRerankDriver
#1558
Replies: 4 comments 1 reply
-
|
Instead of Ollama - can we create a LocalRerankDriver? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Great idea! |
Beta Was this translation helpful? Give feedback.
-
|
Can you point me to Ollama's rerank functionality? I can't seem to find anything on it. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I don't know if there is actually anything with Ollama that has it that's been released.. ollama/ollama#7219 maybe a LocalRerankDriver is a better way to go in the meantime? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently there's no way to Rerank using the RagEngine unless you have a Cohere account. It would be very helpful to have a way to run a local RerankDriver. Would it be possible to make one for Ollama? It has two reranking models available..
linux6200/bge-reranker-v2-m3
zyw0605688/bge-reranker-v2-m3
Beta Was this translation helpful? Give feedback.
All reactions