Skip to content

Fix for vLLM cache kernel signature update (fp8 attention)#223

Merged
masahi merged 1 commit intooctoml:batch-servingfrom masahi:cache-dtype-fixFeb 27, 2024

Commits

Commits on Feb 27, 2024