Migrate logits computation and gather to model_runner#3233
Merged
zhuohan123 merged 22 commits intovllm-project:mainfrom esmeetu:perf-samplerMar 20, 2024
+577-306
Commits
Commits on Mar 14, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed