Skip to content

[Core] Reduce unnecessary compute when logprobs=None#6532

Merged
comaniac merged 15 commits intovllm-project:mainfrom peng1999:opt-logprobsJul 29, 2024

Commits

Commits on Jul 18, 2024

Commits on Jul 22, 2024

Commits on Jul 23, 2024

Commits on Jul 24, 2024

Commits on Jul 25, 2024

Commits on Jul 29, 2024