Skip to content

Support Smooth Softmax in GroupQueryAttention#21867

Merged
tianleiwu merged 9 commits intomainfrom smooth_softmax_gqa_flash_and_cpuAug 27, 2024

Commits

Commits on Aug 21, 2024

Commits on Aug 26, 2024

Commits on Aug 27, 2024