[Core] Support tensor parallelism for GGUF quantization#7520
Merged
mgoin merged 9 commits intovllm-project:mainfrom Isotr0py:gguf-tpAug 19, 2024
+39-15
Commits
Commits on Aug 9, 2024
- committed
Commits on Aug 14, 2024
- committed
- committed
Commits on Aug 15, 2024
- committed