Skip to content

Commit

Permalink
[Build] Disable sm_90a in cu11 (vllm-project#5141)
Browse files Browse the repository at this point in the history
  • Loading branch information
simon-mo authored and blinkbear committed Jun 6, 2024
1 parent 21da7de commit d2900fe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -200,7 +200,7 @@ if(VLLM_GPU_LANG STREQUAL "CUDA")
# The CUTLASS kernels for Hopper require sm90a to be enabled.
# This is done via the below gencode option, BUT that creates kernels for both sm90 and sm90a.
# That adds an extra 17MB to compiled binary, so instead we selectively enable it.
if(${CMAKE_CUDA_COMPILER_VERSION} VERSION_GREATER 12.0)
if(${CMAKE_CUDA_COMPILER_VERSION} VERSION_GREATER 11)
set_source_files_properties(
"csrc/quantization/cutlass_w8a8/scaled_mm_dq_c3x.cu"
PROPERTIES
Expand Down

0 comments on commit d2900fe

Please sign in to comment.