[distributed][kernel]support tensor-parallelism in bitsandbytes quant…#5813

Closed

chenqianfzh wants to merge 1 commit intovllm-project:mainfrom bd-iaas-us:qian/qlora-tp

+82-12

Commits on Jun 25, 2024

[distributed][kernel]support tensor-parallelism in bitsandbytes quantization
chenqianfzh
committed