Skip to content

Commit

Permalink
[Bugfix] Remove key sorting for guided_json parameter in OpenAi com…
Browse files Browse the repository at this point in the history
…patible Server (vllm-project#3945)
  • Loading branch information
dmarasco authored Apr 10, 2024
1 parent e353974 commit e4c4072
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/model_executor/guided_decoding.py
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ def _get_guide_and_mode(
json = request.guided_json
if isinstance(json, dict):
# turn dict into hashable string
json = json_dumps(json, sort_keys=True)
json = json_dumps(json)
elif isinstance(json, BaseModel):
# use pydantic signature so that different model classes
# with the same fields will get hashed the same
Expand Down

0 comments on commit e4c4072

Please sign in to comment.