Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sn1 437 implement gemma 3 27 b it #644

Merged
merged 24 commits into from
Mar 18, 2025
Merged

Sn1 437 implement gemma 3 27 b it #644

Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
9f90feb
Merge pull request #621 from macrocosm-os/staging
bkb2135 Mar 12, 2025
9a53570
Merge pull request #642 from macrocosm-os/staging
bkb2135 Mar 12, 2025
7aa9052
Add gemma model and change llm_model to list
bkb2135 Mar 14, 2025
b992a27
Linting
bkb2135 Mar 14, 2025
44001c2
Remove class method
bkb2135 Mar 14, 2025
071e725
Adjust for LLM_MODEL being a list
bkb2135 Mar 14, 2025
4fa07ce
Add logic for deleting hf models
bkb2135 Mar 14, 2025
1904ff7
Move to cpu then delete
bkb2135 Mar 14, 2025
10f5897
Fix multi-choice
dbobrenko Mar 17, 2025
a164021
Update version
dbobrenko Mar 17, 2025
6f9dbb7
v2.17.6
dbobrenko Mar 17, 2025
f3ea57e
Merge branch 'main' of https://github.com/macrocosm-os/prompting into…
bkb2135 Mar 17, 2025
6142366
Remove unused pipeline
bkb2135 Mar 17, 2025
2280b6f
Load model based on settings config
bkb2135 Mar 17, 2025
7eacb91
Update pyproject.toml
bkb2135 Mar 17, 2025
e8b18aa
Rename llama key
bkb2135 Mar 17, 2025
4be892e
Update Lock File
bkb2135 Mar 17, 2025
b3151bd
Format gemma messages before inferencing
bkb2135 Mar 17, 2025
4610cd4
Create 3 classes
bkb2135 Mar 17, 2025
4ca49f7
Alternate Assistant and User
bkb2135 Mar 17, 2025
03d1633
Precommit Fix
richwardle Mar 18, 2025
f7b8b45
Update Gemma Syntax
bkb2135 Mar 18, 2025
fbf3611
Replace Gemma with Mistral Model
bkb2135 Mar 18, 2025
25b9586
Simplify Unload Model
richwardle Mar 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update pyproject.toml
  • Loading branch information
@bkb2135
bkb2135 committed Mar 17, 2025
commit 7eacb91d3bdc84fd13cfc0255a968802dc9b8401
2 changes: 1 addition & 1 deletion pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,7 @@ pillow = "^11.0.0"
torch = { version = "2.5.1", optional = true }
# TODO: Switch to original repo when this PR to fix setup gets merged: https://github.com/casper-hansen/AutoAWQ/pull/715
autoawq = { git = "https://github.com/jiqing-feng/AutoAWQ.git", rev = "ae782a99df2f72a2c28764452844cb2d65bd8ffc", optional = true }
transformers = { version = "<=4.47.1", optional = true }
transformers = { git = "https://github.com/huggingface/transformers.git", rev = "v4.49.0-Gemma-3", optional = true }
torchvision = { version = ">=0.20.1", optional = true }
accelerate = { version = ">=1.1.1", optional = true }
angle-emb = { version = "0.4.3", optional = true }
Expand Down