This repository has been archived by the owner on Oct 11, 2024. It is now read-only.
[ CI ] Upstream sync to v0.4.3 branch#377
Closed
robertgshaw2-redhat wants to merge 77 commits into0.4.0-branchfrom 0.4.3-branch
+17,454-8,896
Commits
Commits on Jul 14, 2024
- committed
[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (vllm-project#4799)
- committed
[Core] Cross-attention KV caching and memory-management (towards eventual encoder/decoder model support) (vllm-project#4837)
- committed
- committed
[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5) (vllm-project#5136)
Revert "[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5)" (vllm-project#5149)
