Introducing langchain_fllama: A bridge between llama.cpp with Flutter and langchain_dart

[breitburg]

Hey!

I've recently developed a Langchain extension that bridges llama.cpp running in Flutter with langchain_dart, allowing you to build advanced on-device AI experiences. You can use any .gguf model with Langchain within any Flutter app, relying solely on local compute.

It was made possible because of Fllama, a project that brought a bundled llama.cpp to Flutter. Don't hesitate to try it out or contribute.

Link to langchain_fllama: https://github.com/breitburg/langchain_fllama