Skip to content

[Bugfix] Generate exactly input_len tokens in benchmark_throughput#9592

Merged
WoosukKwon merged 1 commit intovllm-project:mainfrom heheda12345:benchmark_throughput_input_lenOct 23, 2024
+10-1

Commits

Commits on Oct 22, 2024