Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✨ feat: add vLLM provider support #6154

Merged
merged 3 commits into from
Feb 14, 2025
Merged

✨ feat: add vLLM provider support #6154

merged 3 commits into from
Feb 14, 2025
+186 −0

Conversation

hezhijie0327
Copy link
Contributor

@hezhijie0327 hezhijie0327 commented Feb 14, 2025 •
edited
Loading

💻 变更类型 | Change Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 👷 build
  • ⚡️ perf
  • 📝 docs
  • 🔨 chore

🔀 变更说明 | Description of Change

  1. vLLM Logo 适配 [TODO]
  2. 内建模型列表更新 [TODO]
  3. 支持模型列表自动获取

📝 补充信息 | Additional Information

close #6147
close #2267

@vercel Vercel
Copy link

vercel bot commented Feb 14, 2025

@hezhijie0327 is attempting to deploy a commit to the LobeHub Team on Vercel.

A member of the Team first needs to authorize it.

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. 🌠 Feature Request New feature or request | 特性与建议 labels Feb 14, 2025
@lobehubbot
Copy link
Member

👍 @hezhijie0327

Thank you for raising your pull request and contributing to our Community
Please make sure you have followed our contributing guidelines. We will review it as soon as possible.
If you encounter any problems, please feel free to connect with us.
非常感谢您提出拉取请求并为我们的社区做出贡献，请确保您已经遵循了我们的贡献指南，我们会尽快审查它。
如果您遇到任何问题，请随时与我们联系。

@codecov Codecov
Copy link

codecov bot commented Feb 14, 2025 •
edited
Loading

Codecov Report

Attention: Patch coverage is 83.24022% with 30 lines in your changes missing coverage. Please review.

Project coverage is 91.73%. Comparing base (ab796a7) to head (dd96065).
Report is 6 commits behind head on main.

Files with missing lines Patch % Lines
src/libs/agent-runtime/vllm/index.ts 38.63% 27 Missing ⚠️
src/libs/agent-runtime/AgentRuntime.ts 57.14% 3 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #6154      +/-   ##
==========================================
- Coverage   91.75%   91.73%   -0.03%     
==========================================
  Files         663      666       +3     
  Lines       60736    60915     +179     
  Branches     2842     2844       +2     
==========================================
+ Hits        55731    55880     +149     
- Misses       5005     5035      +30
Flag Coverage Δ
app 91.73% <83.24%> (-0.03%) ⬇️
server 97.90% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@arvinxx
Copy link
Contributor

arvinxx commented Feb 14, 2025

vllm logo lobehub/lobe-icons#75

@vercel Vercel
Copy link

vercel bot commented Feb 14, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
lobe-chat-preview ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 14, 2025 2:49pm

@arvinxx arvinxx merged commit 1708e32 into lobehub:main Feb 14, 2025
10 of 12 checks passed
@lobehubbot
Copy link
Member

❤️ Great PR @hezhijie0327 ❤️

The growth of project is inseparable from user feedback and contribution, thanks for your contribution! If you are interesting with the lobehub developer community, please join our discord and then dm @arvinxx or @canisminor1990. They will invite you to our private developer channel. We are talking about the lobe-chat development or sharing ai newsletter around the world.
项目的成长离不开用户反馈和贡献，感谢您的贡献! 如果您对 LobeHub 开发者社区感兴趣，请加入我们的 discord，然后私信 @arvinxx 或 @canisminor1990。他们会邀请您加入我们的私密开发者频道。我们将会讨论关于 Lobe Chat 的开发，分享和讨论全球范围内的 AI 消息。

github-actions bot pushed a commit that referenced this pull request Feb 14, 2025
@semantic-release-bot
🔖 chore(release): v1.55.0 [skip ci]
848cf4f 
## [Version&nbsp;1.55.0](v1.54.0...v1.55.0)
<sup>Released on **2025-02-14**</sup>

#### ✨ Features

- **misc**: Add vLLM provider support.

<br/>

<details>
<summary><kbd>Improvements and Fixes</kbd></summary>

#### What's improved

* **misc**: Add vLLM provider support, closes [#6154](#6154) ([1708e32](1708e32))

</details>

<div align="right">

[![](https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square)](#readme-top)

</div>
@lobehubbot
Copy link
Member

🎉 This PR is included in version 1.55.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

github-actions bot pushed a commit to bentwnghk/lobe-chat that referenced this pull request Feb 14, 2025
@semantic-release-bot
🔖 chore(release): v1.97.0 [skip ci]
2916160 
## [Version&nbsp;1.97.0](v1.96.0...v1.97.0)
<sup>Released on **2025-02-14**</sup>

#### ✨ Features

- **misc**: Add vLLM provider support.

<br/>

<details>
<summary><kbd>Improvements and Fixes</kbd></summary>

#### What's improved

* **misc**: Add vLLM provider support, closes [lobehub#6154](https://github.com/bentwnghk/lobe-chat/issues/6154) ([1708e32](1708e32))

</details>

<div align="right">

[![](https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square)](#readme-top)

</div>
@hezhijie0327 hezhijie0327 deleted the vllm branch February 14, 2025 22:29
ramu-narasinga pushed a commit to ramu-narasinga/lobe-chat that referenced this pull request Feb 17, 2025
@hezhijie0327 @ramu-narasinga
✨ feat: add vLLM provider support (lobehub#6154)
2d5c130 
* ✨ feat: add vLLM provider support

* 💄 style: update model list
ramu-narasinga pushed a commit to ramu-narasinga/lobe-chat that referenced this pull request Feb 17, 2025
@semantic-release-bot @ramu-narasinga
🔖 chore(release): v1.55.0 [skip ci]
829faef 
## [Version&nbsp;1.55.0](lobehub/lobe-chat@v1.54.0...v1.55.0)
<sup>Released on **2025-02-14**</sup>

#### ✨ Features

- **misc**: Add vLLM provider support.

<br/>

<details>
<summary><kbd>Improvements and Fixes</kbd></summary>

#### What's improved

* **misc**: Add vLLM provider support, closes [lobehub#6154](lobehub#6154) ([1708e32](lobehub@1708e32))

</details>

<div align="right">

[![](https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square)](#readme-top)

</div>
bentwnghk pushed a commit to bentwnghk/lobe-chat that referenced this pull request Feb 20, 2025
@hezhijie0327 @bentwnghk
✨ feat: add vLLM provider support (lobehub#6154)
6ebaece 
* ✨ feat: add vLLM provider support

* 💄 style: update model list
likaiqiang pushed a commit to likaiqiang/lobe-chat that referenced this pull request Feb 26, 2025
@hezhijie0327 @likaiqiang
✨ feat: add vLLM provider support (lobehub#6154)
f3e6f16 
* ✨ feat: add vLLM provider support

* 💄 style: update model list
likaiqiang pushed a commit to likaiqiang/lobe-chat that referenced this pull request Feb 26, 2025
@semantic-release-bot @likaiqiang
🔖 chore(release): v1.55.0 [skip ci]
9e4832f 
## [Version&nbsp;1.55.0](lobehub/lobe-chat@v1.54.0...v1.55.0)
<sup>Released on **2025-02-14**</sup>

#### ✨ Features

- **misc**: Add vLLM provider support.

<br/>

<details>
<summary><kbd>Improvements and Fixes</kbd></summary>

#### What's improved

* **misc**: Add vLLM provider support, closes [lobehub#6154](lobehub#6154) ([1708e32](lobehub@1708e32))

</details>

<div align="right">

[![](https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square)](#readme-top)

</div>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
🌠 Feature Request New feature or request | 特性与建议 released size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Request] VLLM support [Request] 能支持vllm吗？
3 participants
@hezhijie0327 @lobehubbot @arvinxx