Fix: Output text is always truncated in some models#3016

Merged

WoosukKwon merged 3 commits intovllm-project:mainfrom HyperdriveHustle:check_stop_str

Mar 1, 2024

+4-1

Commits on Feb 24, 2024

Add stop_str check before truncating according to stop token length
HyperdriveHustle
committed

Commits on Feb 27, 2024

Refine judgment logic to prevent unstoppable generation.
HyperdriveHustle
committed

Commits on Mar 1, 2024

yapf
WoosukKwon
committed