-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
added breakdown bar for context #76
base: main
Are you sure you want to change the base?
Conversation
I think this is an interesting feature, especially if we could show how much of the context is left. But as it stands, this does look ugly and out of place. Honestly, I'm not very good with colors (or any kind of design), so I'm not sure about what to suggest in this case. Maybe for the color it would be necessary to add a palette to all themes, instead of just one color? |
Added a "Free Context" part to the bar. I can't test it as I don't have llamacpp set up right now, but it should work. I'll try to get it up and running again soonish and check. As for the different colours for different themes, I frankly cannot be arsed to come up with even more colours, but I have added classes to all the bars the component generates, so it is now possible to do that. |
Keep in mind that the free context part is not accurate since we just guesstimate prompt size, so it's not all that useful.
Maybe I'll wrestle with that sometime when I have absolutely nothing else going on.
Oh that's weird, never noticed that. |
Hm, that's true, and this "guesstimation" must be quite off for models like LLaMA 3, which tokenize much more effectively than other models. But I guess that's not the breakdown bar's fault at least. |
Added bars that show the composition of your current context in the sidebar and in the context modal. Per default, it isn't visible in the sidebar and has to be turned on in the editor settings modal.
We should probably talk about the colors, because it's pretty ugly right now.