Skip to content

[Model] Remap FP8 kv_scale in CommandR and DBRX#9174

Merged
comaniac merged 2 commits intovllm-project:mainfrom hliuca:kv_scale_remapOct 9, 2024
+14-2

Commits

Commits on Oct 4, 2024

Commits on Oct 9, 2024