Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FastAPI-based working frontend #10

Merged
merged 14 commits into from
Mar 29, 2023
Merged

FastAPI-based working frontend #10

merged 14 commits into from
Mar 29, 2023
+536 −146

Conversation

zhuohan123
Copy link
Member

@zhuohan123 zhuohan123 commented Mar 27, 2023 •
edited
Loading

Add a FastAPI-based frontend to cacheflow while keeping the old script working.

Remaining TODOs:

  • Add a README for the FastAPI frontend.
  • Rename the old script.
  • Add a gradio demo web frontend.

@zhuohan123 zhuohan123 requested a review from WoosukKwon March 27, 2023 06:19
WoosukKwon
WoosukKwon approved these changes Mar 28, 2023
View reviewed changes
Copy link
Collaborator

@WoosukKwon WoosukKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for your effort.

@zhuohan123 zhuohan123 merged commit 721fa3d into main Mar 29, 2023
@zhuohan123 zhuohan123 deleted the real-frontend branch March 29, 2023 06:49
@TheBloke TheBloke mentioned this pull request Jul 20, 2023
Closed
xiangyuT pushed a commit to xiangyuT/vllm that referenced this pull request Oct 25, 2023
@gc-fu
Clean unused KVCache after usage (vllm-project#10)
fbcfee9 
* Add underlying functions

* tests done
@shanshanpt shanshanpt mentioned this pull request Nov 17, 2023
Closed
@junior-zsy junior-zsy mentioned this pull request Nov 20, 2023
Closed
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
@zhuohan123
FastAPI-based working frontend (vllm-project#10)
e1f8fcc
slyalin pushed a commit to slyalin/vllm that referenced this pull request Mar 22, 2024
@ilya-lavrenov
Merge pull request vllm-project#10 from slyalin/trust_remote_code_pas…
a398824 
…sthrough

Passthrough trust_remote_code
@yuhuixu1993 yuhuixu1993 mentioned this pull request Jun 2, 2024
Closed
ykim362 pushed a commit to ykim362/vllm that referenced this pull request Jun 17, 2024
@xiaoxiawu-microsoft
Merge pull request vllm-project#10 from wenxcs/wenxh/fp8-on-a100-v1-pr
94d4614 
Wenxh/fp8 on a100 v1 pr
@alixiaodi alixiaodi mentioned this pull request Aug 2, 2024
Closed
zeroorhero pushed a commit to zeroorhero/vllm that referenced this pull request Sep 23, 2024
@KuntaiDu
Merge pull request vllm-project#10 from KuntaiDu/kuntai-disagg-refactor
0d81aaf 
Kuntai disagg refactor
@SpaceHunterInf SpaceHunterInf mentioned this pull request Sep 30, 2024
Closed
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@WoosukKwon WoosukKwon WoosukKwon approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zhuohan123 @WoosukKwon