fix: openai_api 的 stream api,服务端全部生成文本后客户端才一次性收到 #152
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
不知道是不是我个例,
openai_api.py
里面的create_chat_completion
方法,stream=True
的时候没能有“流式”效果。所以用sse_starlette.sse
改写了一下。另外在
predict
函数末尾加上yield '[DONE]'
,有些openai的客户端才能识别到“结束”