[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models.#6485
Merged
cadedaniel merged 45 commits intovllm-project:mainfrom sroy745:sroy-sd-disable-log-probJul 21, 2024
+332-63
Commits
Commits on May 29, 2024
Commits on Jun 3, 2024
Commits on Jun 7, 2024
Commits on Jun 10, 2024
Commits on Jun 12, 2024
Commits on Jun 14, 2024
Commits on Jun 17, 2024
Commits on Jun 20, 2024
Commits on Jun 24, 2024
Commits on Jun 27, 2024
Commits on Jun 28, 2024
Commits on Jun 29, 2024
Commits on Jul 1, 2024
Commits on Jul 6, 2024
Commits on Jul 10, 2024
Commits on Jul 15, 2024
Commits on Jul 16, 2024
Commits on Jul 17, 2024
Commits on Jul 19, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- authored
- committed
- committed
Commits on Jul 20, 2024
- committed
- committed
Commits on Jul 21, 2024
- committed
- committed
- committed