Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v2.17.7 #650

Merged
merged 32 commits into from
Mar 18, 2025
Merged

v2.17.7 #650

merged 32 commits into from
Mar 18, 2025

Conversation

bkb2135
Copy link
Collaborator

@bkb2135 bkb2135 commented Mar 18, 2025 •
edited by dbobrenko
Loading

Changes

  • Add Mistral 3.1 small.
  • Upgrade Transformers dependency.
  • Address API throttling.

dbobrenko and others added 29 commits February 27, 2025 14:00
@dbobrenko
Limit queue size, add logs
6588549
@dbobrenko
Fix timers logging; code clean up
61b2676
@dbobrenko
Add scoring queue rate-limit delay by default
762bc99
@dbobrenko
Add min wait time to scoring queue
5a45f56
@dbobrenko
Format code
307a1ca
@bkb2135
Add gemma model and change llm_model to list
7aa9052
@bkb2135
Linting
b992a27
@bkb2135
Remove class method
44001c2
@bkb2135
Adjust for LLM_MODEL being a list
071e725
@bkb2135
Add logic for deleting hf models
4fa07ce
@bkb2135
Move to cpu then delete
1904ff7
@dbobrenko
Merge branch 'staging' into fix/SN1-411-api-throttle
64adfd8
@dbobrenko
Make embedding class var instead of globalvar
2438ad2
@bkb2135
Merge branch 'main' of https://github.com/macrocosm-os/prompting into…
f3ea57e 
… SN1-437-implement-gemma-3-27-b-it
@dbobrenko
Merge pull request #631 from macrocosm-os/fix/SN1-411-api-throttle
4625e04 
Reduce API throttle
@bkb2135
Remove unused pipeline
6142366
@bkb2135
Load model based on settings config
2280b6f
@bkb2135
Update pyproject.toml
7eacb91
@bkb2135
Rename llama key
e8b18aa
@bkb2135
Update Lock File
4be892e
@bkb2135
Format gemma messages before inferencing
b3151bd
@bkb2135
Create 3 classes
4610cd4
@bkb2135
Alternate Assistant and User
4ca49f7
@bkb2135
Merge pull request #649 from macrocosm-os/main
fc04646 
Prepare for Release
@richwardle
Precommit Fix
03d1633
@bkb2135
Update Gemma Syntax
f7b8b45
@bkb2135
Replace Gemma with Mistral Model
fbf3611
@richwardle
Simplify Unload Model
25b9586
@bkb2135
Merge pull request #644 from macrocosm-os/SN1-437-implement-gemma-3-2…
b86049a 
…7-b-it

Sn1 437 implement gemma 3 27 b it
richwardle
richwardle approved these changes Mar 18, 2025
View reviewed changes
Copy link
Collaborator

@richwardle richwardle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG

dbobrenko
dbobrenko approved these changes Mar 18, 2025
View reviewed changes
Copy link
Collaborator

@dbobrenko dbobrenko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@bkb2135 bkb2135 merged commit bec13a6 into main Mar 18, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dbobrenko dbobrenko dbobrenko approved these changes

@richwardle richwardle richwardle approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@bkb2135 @dbobrenko @richwardle