Skip to content

[Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi #4573

Merged
simon-mo merged 37 commits intovllm-project:mainfrom DefTruth:prefill-pow-2-alibiMay 8, 2024

Commits

Commits on Apr 30, 2024

Commits on May 1, 2024

Commits on May 2, 2024

Commits on May 3, 2024

Commits on May 4, 2024

Commits on May 5, 2024

Commits on May 6, 2024

Commits on May 7, 2024