Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI/Build] Add support for Python 3.13 #13164

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
+6 −5
Draft

[CI/Build] Add support for Python 3.13 #13164

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6be84ad
[CI/Build] Add support for Python 3.13
mgoin Feb 12, 2025
77b74b6
More updates
mgoin Feb 12, 2025
fec86c2
Merge branch 'main' into add-python-3.13
mgoin Feb 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ set(ignoreMe "${VLLM_PYTHON_PATH}")
# Supported python versions. These versions will be searched in order, the
# first match will be selected. These should be kept in sync with setup.py.
#
set(PYTHON_SUPPORTED_VERSIONS "3.9" "3.10" "3.11" "3.12")
set(PYTHON_SUPPORTED_VERSIONS "3.9" "3.10" "3.11" "3.12", "3.13")

# Supported NVIDIA architectures.
set(CUDA_SUPPORTED_ARCHS "7.0;7.2;7.5;8.0;8.6;8.7;8.9;9.0")
Expand Down
2 changes: 1 addition & 1 deletion docs/source/getting_started/installation/gpu/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
## Requirements

- OS: Linux
- Python: 3.9 -- 3.12
- Python: 3.9 -- 3.13

:::::{tab-set}
:sync-group: device
Expand Down
2 changes: 1 addition & 1 deletion docs/source/getting_started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ This guide will help you quickly get started with vLLM to perform:
## Prerequisites

- OS: Linux
- Python: 3.9 -- 3.12
- Python: 3.9 -- 3.13

## Installation

Expand Down
2 changes: 1 addition & 1 deletion requirements-common.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ tiktoken >= 0.6.0 # Required for DBRX tokenizer
lm-format-enforcer >= 0.10.9, < 0.11
outlines == 0.1.11
lark == 1.2.2
xgrammar == 0.1.11; platform_machine == "x86_64"
xgrammar == 0.1.11; platform_machine == "x86_64" and python_version < '3.13'
typing_extensions >= 4.10
filelock >= 3.16.1 # need to contain https://github.com/tox-dev/filelock/pull/317
partial-json-parser # used for parsing partial JSON outputs
Expand Down
2 changes: 1 addition & 1 deletion requirements-cuda.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
-r requirements-common.txt

# Dependencies for NVIDIA GPUs
ray[default] >= 2.9
ray[default] >= 2.9; python_version < '3.13'
torch == 2.5.1
torchaudio==2.5.1
# These must be updated alongside torch
Expand Down
1 change: 1 addition & 0 deletions setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -667,6 +667,7 @@ def _read_requirements(filename: str) -> List[str]:
"Programming Language :: Python :: 3.10",
"Programming Language :: Python :: 3.11",
"Programming Language :: Python :: 3.12",
"Programming Language :: Python :: 3.13",
"License :: OSI Approved :: Apache Software License",
"Intended Audience :: Developers",
"Intended Audience :: Information Technology",
Expand Down