-
-
Notifications
You must be signed in to change notification settings - Fork 10.9k
Closed
Labels
installationInstallation problemsInstallation problems
Description
Your current environment
The output of `python collect_env.py`
How you are installing vllm
Is there a version of vllm that is compatible with the latest PyTorch release 2.9.0?
pip install vllm==0.11.0
pip install torch==2.9.0
$ vllm bench latency --input-len 256 --output-len 256 --model Qwen3/Qwen3-8B --batch-size 1
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
Aborted (core dumped)
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Metadata
Metadata
Assignees
Labels
installationInstallation problemsInstallation problems