Skip to content

Conversation

mgoin
Copy link
Member

@mgoin mgoin commented Feb 12, 2025

FIX #12083

Tested that basic vllm serve works

uv venv --python 3.13 ~/venvs/py313
source ~/venvs/py313/bin/activate
VLLM_USE_PRECOMPILED=1 uv pip install -U -e . --torch-backend=cu128
vllm serve Qwen/Qwen3-0.6B
...
(APIServer pid=2520745) INFO:     Application startup complete.

Dependencies that are blockers for python 3.13 support:

Copy link

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

@mergify mergify bot added the ci/build label Feb 12, 2025
@mgoin mgoin marked this pull request as draft February 12, 2025 17:01
Signed-off-by: mgoin <[email protected]>
@mergify mergify bot added the documentation Improvements or additions to documentation label Feb 12, 2025
@Ryp
Copy link
Contributor

Ryp commented Feb 12, 2025

I think you'd also need a matching PR on https://github.com/vllm-project/flash-attention/blob/main/CMakeLists.txt#L22

Run locally with TORCH_CUDA_ARCH_LIST="Auto" VLLM_BUILD_DIR=build pip install -v --no-clean --no-build-isolation -e . and you should run into the error if you didn't patch this part.

Copy link

mergify bot commented Feb 17, 2025

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @mgoin.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify bot added the needs-rebase label Feb 17, 2025
@Ryp Ryp mentioned this pull request Feb 17, 2025
@mergify mergify bot removed the needs-rebase label Feb 17, 2025
Ryp added a commit to Ryp/vllm that referenced this pull request Feb 25, 2025
This is required for vllm-project#13164 as this version has wheels for python 3.13

Signed-off-by: Thibault Schueller <[email protected]>
@manueldeprada
Copy link

ray-project/ray#49738

ray already has 3.13 nightly builds, stable wheel coming with next release probably

Copy link

mergify bot commented Mar 6, 2025

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @mgoin.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify bot added the needs-rebase label Mar 6, 2025
@Ryp
Copy link
Contributor

Ryp commented Mar 12, 2025

Can you please update the blocker list? Sound like xgrammar is not longer an issue since we're on 0.1.15 now: #14563
Also python 3.13 is now supported in flash attention as well!

@21m1n
Copy link

21m1n commented Mar 24, 2025

bumped into this error when i pip install vllm in a newly created environment.

python version 3.13.0

Collecting numba==0.60.0 (from vllm)
  Using cached numba-0.60.0.tar.gz (2.7 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [24 lines of output]
      Traceback (most recent call last):
        File "/home/zimin/miniconda3/envs/vllm/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
          ~~~~^^
        File "/home/zimin/miniconda3/envs/vllm/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ~~~~^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/zimin/miniconda3/envs/vllm/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-moyn66y8/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 334, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-moyn66y8/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 304, in _get_build_requires
          self.run_setup()
          ~~~~~~~~~~~~~~^^
        File "/tmp/pip-build-env-moyn66y8/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 522, in run_setup
          super().run_setup(setup_script=setup_script)
          ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-moyn66y8/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 320, in run_setup
          exec(code, locals())
          ~~~~^^^^^^^^^^^^^^^^
        File "<string>", line 51, in <module>
        File "<string>", line 48, in _guard_py_ver
      RuntimeError: Cannot install on Python version 3.13.2; only versions >=3.9,<3.13 are supported.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

@mergify mergify bot removed the needs-rebase label Mar 28, 2025
@mgoin
Copy link
Member Author

mgoin commented Mar 28, 2025

Updated the list and it seems like ray is still going to be a blocker until 2.45 comes out ray-project/ray#49738 (comment)

@dan-and
Copy link

dan-and commented Apr 23, 2025

Also numba needs to be 0.62 to work with python 3.13

@manueldeprada
Copy link

@mgoin ray 2.45 is out :)

princepride pushed a commit to princepride/vllm that referenced this pull request Aug 20, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
divakar-amd pushed a commit to divakar-amd/vllm_upstream that referenced this pull request Aug 20, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
cyang49 pushed a commit to cyang49/vllm that referenced this pull request Aug 20, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
djmmoss pushed a commit to djmmoss/vllm that referenced this pull request Aug 21, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
Signed-off-by: Duncan Moss <[email protected]>
@simon-mo simon-mo mentioned this pull request Aug 21, 2025
1 task
epwalsh pushed a commit to epwalsh/vllm that referenced this pull request Aug 28, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
xiao-llm pushed a commit to xiao-llm/vllm that referenced this pull request Aug 28, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
Signed-off-by: Xiao Yu <[email protected]>
zhewenl pushed a commit to zhewenl/vllm that referenced this pull request Aug 28, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
mengxingkongzhouhan pushed a commit to mengxingkongzhouhan/vllm that referenced this pull request Aug 30, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
zhewenl pushed a commit to zhewenl/vllm that referenced this pull request Sep 3, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
FeiDaLI pushed a commit to FeiDaLI/vllm that referenced this pull request Sep 25, 2025
Signed-off-by: mgoin <[email protected]>
Signed-off-by: mgoin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 2, 2025
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 2, 2025
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 2, 2025
Notably adds Python 3.13 support (see vllm-project/vllm#13164) among many other things (https://github.com/vllm-project/vllm/releases/tag/v0.10.2).

Co-authored-by: Gaétan Lepage <[email protected]>
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 3, 2025
Notably adds Python 3.13 support (see vllm-project/vllm#13164) among many other things (https://github.com/vllm-project/vllm/releases/tag/v0.10.2).

Co-authored-by: Gaétan Lepage <[email protected]>
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 3, 2025
Notably adds Python 3.13 support (see vllm-project/vllm#13164) among many other things (https://github.com/vllm-project/vllm/releases/tag/v0.10.2).

Co-authored-by: Gaétan Lepage <[email protected]>
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 3, 2025
Notably adds Python 3.13 support (see vllm-project/vllm#13164) among many other things (https://github.com/vllm-project/vllm/releases/tag/v0.10.2).

Co-authored-by: Gaétan Lepage <[email protected]>
daniel-fahey added a commit to daniel-fahey/nixpkgs that referenced this pull request Oct 4, 2025
Notably adds Python 3.13 support (see vllm-project/vllm#13164) among many other things (https://github.com/vllm-project/vllm/releases/tag/v0.10.2).

Co-authored-by: Gaétan Lepage <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/build documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Support Python 3.13