Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LETTA-FREE model #2481

Open
gbanusi opened this issue Mar 13, 2025 · 1 comment
Open

LETTA-FREE model #2481

gbanusi opened this issue Mar 13, 2025 · 1 comment

Comments

@gbanusi
Copy link

gbanusi commented Mar 13, 2025 •
edited
Loading

Hi!

I'm interested in power of letta free model,
how much vRAM does it take, how big is it, is it on hugging face?

Also I noticed that it doesnt condense the messages, it just runs into an error when the context is filled...

Any documentation on it? Just some basic info?
@quantumalchemy
Copy link

The free model -- its the free endpoint from letta you can use by default just to get started
the actual LLM was a opensource llm -- I believe was based on: dolphin-2.7-mixtral-8x7b but may have changed
anyway its not really working anymore since like v0.6..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@quantumalchemy @gbanusi