Code

v2.17.7#650

Code

Merged

bkb2135 merged 32 commits intomainmacrocosm-os/prompting:mainfrom stagingmacrocosm-os/prompting:stagingCopy head branch name to clipboardMar 18, 2025

Commits

Commits on Feb 27, 2025

• Limit queue size, add logs

  dbobrenko

  committed
  6588549

  Copy full SHA for 6588549

• Fix timers logging; code clean up

  dbobrenko

  committed
  61b2676

  Copy full SHA for 61b2676

• Add scoring queue rate-limit delay by default

  dbobrenko

  committed
  762bc99

  Copy full SHA for 762bc99

• Add min wait time to scoring queue

  dbobrenko

  committed
  5a45f56

  Copy full SHA for 5a45f56

Commits on Feb 28, 2025

• Format code

  dbobrenko

  committed
  307a1ca

  Copy full SHA for 307a1ca

Commits on Mar 14, 2025

• Add gemma model and change llm_model to list

  bkb2135

  committed
  7aa9052

  Copy full SHA for 7aa9052

• Linting

  bkb2135

  committed
  b992a27

  Copy full SHA for b992a27

• Remove class method

  bkb2135

  committed
  44001c2

  Copy full SHA for 44001c2

• Adjust for LLM_MODEL being a list

  bkb2135

  committed
  071e725

  Copy full SHA for 071e725

• Add logic for deleting hf models

  bkb2135

  committed
  4fa07ce

  Copy full SHA for 4fa07ce

• Move to cpu then delete

  bkb2135

  committed
  1904ff7

  Copy full SHA for 1904ff7

• Merge branch 'staging' into fix/SN1-411-api-throttle

  dbobrenko

  committed
  64adfd8

  Copy full SHA for 64adfd8

• Make embedding class var instead of globalvar

  dbobrenko

  committed
  2438ad2

  Copy full SHA for 2438ad2

Commits on Mar 17, 2025

• Merge branch 'main' of https://github.com/macrocosm-os/prompting into SN1-437-implement-gemma-3-27-b-it

  bkb2135

  committed
  f3ea57e

  Copy full SHA for f3ea57e

• Merge pull request #631 from macrocosm-os/fix/SN1-411-api-throttle

  Show description for 4625e04
  dbobrenko

  authored
  4625e04

  Copy full SHA for 4625e04

• Remove unused pipeline

  bkb2135

  committed
  6142366

  Copy full SHA for 6142366

• Load model based on settings config

  bkb2135

  committed
  2280b6f

  Copy full SHA for 2280b6f

• Update pyproject.toml

  bkb2135

  committed
  7eacb91

  Copy full SHA for 7eacb91

• Rename llama key

  bkb2135

  committed
  e8b18aa

  Copy full SHA for e8b18aa

• Update Lock File

  bkb2135

  committed
  4be892e

  Copy full SHA for 4be892e

• Format gemma messages before inferencing

  bkb2135

  committed
  b3151bd

  Copy full SHA for b3151bd

• Create 3 classes

  bkb2135

  committed
  4610cd4

  Copy full SHA for 4610cd4

• Alternate Assistant and User

  bkb2135

  committed
  4ca49f7

  Copy full SHA for 4ca49f7

Commits on Mar 18, 2025

• Merge pull request #649 from macrocosm-os/main

  Show description for fc04646
  bkb2135

  authored
  fc04646

  Copy full SHA for fc04646

• Precommit Fix

  richwardle

  committed
  03d1633

  Copy full SHA for 03d1633

• Update Gemma Syntax

  bkb2135

  committed
  f7b8b45

  Copy full SHA for f7b8b45

• Replace Gemma with Mistral Model

  bkb2135

  committed
  fbf3611

  Copy full SHA for fbf3611

• Simplify Unload Model

  richwardle

  committed
  25b9586

  Copy full SHA for 25b9586

• Merge pull request #644 from macrocosm-os/SN1-437-implement-gemma-3-27-b-it

  Show description for b86049a
  bkb2135

  authored
  b86049a

  Copy full SHA for b86049a

• Use Async Cacheing

  bkb2135

  committed
  a1099b2

  Copy full SHA for a1099b2

• Bump Version Number

  bkb2135

  committed
  0a0c675

  Copy full SHA for 0a0c675

• Merge pull request #651 from macrocosm-os/fix/staging

  Show description for 6aec8b0
  bkb2135

  authored
  6aec8b0

  Copy full SHA for 6aec8b0