Bump torch version to 2.7.1 #1562

leo-pony · 2025-07-01T09:38:48Z

What this PR does / why we need it?

Bump torch version to 2.7.1, and cleanup infer schema patch 857f489 (#837), this patch depends on also: #1974

Does this PR introduce any user-facing change?

No

How was this patch tested?

CI passed

torch-npu 2.7.1rc1 install guide:
https://gitee.com/ascend/pytorch/tree/v2.7.1/
install depending:

pip3 install pyyaml
pip3 install setuptools

install torch-npu:

Closes: #1866
Closes: #1390

vLLM version: v0.10.0
vLLM main: vllm-project/vllm@9af654c

github-actions · 2025-07-01T09:41:33Z

This pull request has conflicts, please resolve those before we can evaluate the pull request.

codecov · 2025-07-04T10:02:51Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 76.31%. Comparing base (ad366bf) to head (6937b7d).
⚠️ Report is 612 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1562      +/-   ##
==========================================
- Coverage   76.41%   76.31%   -0.11%     
==========================================
  Files         113      111       -2     
  Lines       12553    12485      -68     
==========================================
- Hits         9593     9528      -65     
+ Misses       2960     2957       -3

Flag	Coverage Δ
unittests	`76.31% <100.00%> (-0.11%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

github-actions · 2025-07-06T02:44:40Z

This pull request has conflicts, please resolve those before we can evaluate the pull request.

csrc/kernels/get_masked_input_and_mask_kernel.cpp

Yikun

Let's wait torch npu 2.7.1 first POC version.

Yikun · 2025-07-24T07:27:29Z

tests/ut/ops/test_expert_load_balancer.py

 # limitations under the License.
 # This file is a part of the vllm-ascend project.
 #
-


revert unrelated change to avoid cherrypick conflict

Yikun · 2025-07-24T07:28:34Z

csrc/torch_binding.cpp

            size,
            loop_cnt,
            aiv_num);
-


revert unrelated change to avoid cherrypick conflict

Yikun · 2025-07-24T07:28:36Z

csrc/torch_binding.cpp

        int64_t aiv_num = 0;
        TORCH_CHECK(aclGetDeviceCapability(device_id, ACL_DEVICE_INFO_VECTOR_CORE_NUM, &aiv_num) == ACL_SUCCESS);
        uint32_t loop_cnt = (size + aiv_num - 1) / aiv_num;
-


revert unrelated change to avoid cherrypick conflict

Yikun · 2025-07-24T15:01:34Z

README.md

  * Python >= 3.9, < 3.12
  * CANN >= 8.1.RC1
-  * PyTorch >= 2.5.1, torch-npu >= 2.5.1.post1.dev20250619
+  * PyTorch >= 2.7.1, torch-npu >= 2.7.1rc1


Suggested change

* PyTorch >= 2.7.1, torch-npu >= 2.7.1rc1

* PyTorch >= 2.7.1, torch-npu >= 2.7.1.dev20250724

Yikun · 2025-07-24T15:02:42Z

README.zh.md

  * Python >= 3.9, < 3.12
  * CANN >= 8.1.RC1
-  * PyTorch >= 2.5.1, torch-npu >= 2.5.1.post1.dev20250619
+  * PyTorch >= 2.5.1, torch-npu >= 2.7.1rc1


Suggested change

* PyTorch >= 2.5.1, torch-npu >= 2.7.1rc1

* PyTorch >= 2.5.1, torch-npu >= 2.7.1.dev20250724

Yikun · 2025-07-24T15:03:55Z

pyproject.toml

-    "torch-npu==2.5.1.post1.dev20250619",
-    "torch>=2.5.1",
-    "torchvision<0.21.0",
+    "torch-npu==2.7.1rc1",


Suggested change

"torch-npu==2.7.1rc1",

"torch-npu==2.7.1.dev20250724",

Yikun · 2025-07-24T15:04:21Z

requirements.txt

 --pre
 --extra-index-url https://mirrors.huaweicloud.com/ascend/repos/pypi
-torch-npu==2.5.1.post1.dev20250619
+torch-npu==2.7.1rc1


Suggested change

torch-npu==2.7.1rc1

torch-npu==2.7.1.dev20250724

Yikun · 2025-07-24T15:05:18Z

tests/ut/test_utils.py

@@ -1,4 +1,3 @@
-#


revert unrelated change

Yikun · 2025-07-24T15:06:05Z

vllm_ascend/platform.py


        assert is_hccl_available()

-        # TODO(Yizhou): The reason we need to set options while vllm does not


@yiz-liu FYI, we can finally clean up this, thanks for your note.

github-actions · 2025-07-26T14:39:56Z

This pull request has conflicts, please resolve those before we can evaluate the pull request.

github-actions · 2025-07-30T00:49:33Z

This pull request has conflicts, please resolve those before we can evaluate the pull request.

Signed-off-by: Yikun Jiang <[email protected]>

Co-authored-by: leo-pony <[email protected]> Signed-off-by: Yikun Jiang <[email protected]>

Signed-off-by: leo-pony <[email protected]>

### What this PR does / why we need it? Bump torch version to 2.7.1, and cleanup infer schema patch vllm-project@857f489 (vllm-project#837), this patch depends on also: vllm-project#1974 ### Does this PR introduce any user-facing change? No #### How was this patch tested? CI passed torch-npu 2.7.1rc1 install guide: https://gitee.com/ascend/pytorch/tree/v2.7.1/ install depending: ``` pip3 install pyyaml pip3 install setuptools ``` install torch-npu: Closes: vllm-project#1866 Closes: vllm-project#1390 - vLLM version: v0.10.0 - vLLM main: vllm-project/vllm@9af654c --------- Signed-off-by: Yikun Jiang <[email protected]> Signed-off-by: leo-pony <[email protected]> Co-authored-by: Yikun Jiang <[email protected]>

leo-pony marked this pull request as draft July 1, 2025 09:39

github-actions bot added the merge-conflicts label Jul 1, 2025

leo-pony force-pushed the torch_2_7_adapt branch from 41119fe to 6eb684d Compare July 1, 2025 09:44

github-actions bot added module:tests module:core module:quantization labels Jul 1, 2025

leo-pony closed this Jul 1, 2025

leo-pony force-pushed the torch_2_7_adapt branch from 6eb684d to 6db7dc2 Compare July 1, 2025 13:14

leo-pony reopened this Jul 1, 2025

github-actions bot added documentation Improvements or additions to documentation and removed merge-conflicts labels Jul 1, 2025

leo-pony force-pushed the torch_2_7_adapt branch 2 times, most recently from 04ddefc to 7bab351 Compare July 3, 2025 08:34

zheliuyu mentioned this pull request Jul 3, 2025

[Feature]: Request vllm-ascend to support torch_npu>=2.6 #1390

Closed

leo-pony force-pushed the torch_2_7_adapt branch 2 times, most recently from 4f45d58 to b67e468 Compare July 4, 2025 09:45

github-actions bot added the merge-conflicts label Jul 6, 2025

wangxiyuan force-pushed the torch_2_7_adapt branch 2 times, most recently from e113a90 to f10b808 Compare July 9, 2025 03:38

github-actions bot removed the merge-conflicts label Jul 9, 2025

leo-pony mentioned this pull request Jul 9, 2025

[CI] fix wheel build fail: "liberror_manager.so" could not be localed #1690

Closed

github-actions bot added the ci/build label Jul 10, 2025

leo-pony marked this pull request as ready for review July 10, 2025 06:11

leo-pony marked this pull request as draft July 10, 2025 06:13

Yikun added accuracy-test enable all accuracy test for PR ready-for-test start test by label for PR labels Jul 10, 2025

Yikun reviewed Jul 10, 2025

View reviewed changes

csrc/kernels/get_masked_input_and_mask_kernel.cpp Outdated Show resolved Hide resolved

leo-pony marked this pull request as ready for review July 24, 2025 06:46

Yikun reviewed Jul 24, 2025

View reviewed changes

This was referenced Jul 26, 2025

[Feature]: Bump default Python version to 3.11 series #1980

Closed

Bump torch version to 2.7.1 #1527

Closed

github-actions bot added the merge-conflicts label Jul 26, 2025

Yikun mentioned this pull request Jul 28, 2025

[Bug]: Verl qwen2.5 grpo | vllm-ascend 091-dev | ValueError: infer_schema(func): Parameter block_size has unsupported type list[in #1776

Open

leo-pony force-pushed the torch_2_7_adapt branch from 2e3f6f3 to ea79c67 Compare July 29, 2025 13:46

github-actions bot added merge-conflicts and removed merge-conflicts labels Jul 29, 2025

leo-pony mentioned this pull request Aug 1, 2025

[Bug]: export VLLM_USE_V1=1 后启动报错 #1249

Closed

leo-pony force-pushed the torch_2_7_adapt branch from ea79c67 to 5af47d4 Compare August 4, 2025 03:52

github-actions bot removed the merge-conflicts label Aug 4, 2025

Yikun and others added 4 commits August 4, 2025 13:41

Bump torch version to 2.7.1

70d83bf

Signed-off-by: Yikun Jiang <[email protected]>

revert 857f489 68fb634

bd63767

Signed-off-by: Yikun Jiang <[email protected]>

Fix torchvision version

7919a12

Co-authored-by: leo-pony <[email protected]> Signed-off-by: Yikun Jiang <[email protected]>

update to torch-npu 2.7.1.0724 and adapt to torch-npu 2.7.1

6937b7d

Signed-off-by: leo-pony <[email protected]>

leo-pony force-pushed the torch_2_7_adapt branch from 5af47d4 to 6937b7d Compare August 4, 2025 13:42

Yikun approved these changes Aug 5, 2025

View reviewed changes

wangxiyuan approved these changes Aug 5, 2025

View reviewed changes

wangxiyuan merged commit 807f089 into vllm-project:main Aug 5, 2025
25 checks passed

shen-shanshan mentioned this pull request Aug 5, 2025

[Release]: Release checklist for v0.9.1rc2 #2191

Closed

29 tasks

Yikun mentioned this pull request Sep 10, 2025

[Installation][v0.9.1]: The versions for torch_npu in the README and pyproject.toml are different. #2838

Closed

leo-pony deleted the torch_2_7_adapt branch October 14, 2025 02:53

Yikun mentioned this pull request Nov 5, 2025

[Bug]: vllm加载模型报错：AssertionError: camem allocator is not available #3998

Closed

	* PyTorch >= 2.7.1, torch-npu >= 2.7.1rc1
	* PyTorch >= 2.7.1, torch-npu >= 2.7.1.dev20250724

	* PyTorch >= 2.5.1, torch-npu >= 2.7.1rc1
	* PyTorch >= 2.5.1, torch-npu >= 2.7.1.dev20250724


		assert is_hccl_available()

		# TODO(Yizhou): The reason we need to set options while vllm does not

Bump torch version to 2.7.1 #1562

Bump torch version to 2.7.1 #1562

Uh oh!

Conversation

leo-pony commented Jul 1, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this PR does / why we need it?

Does this PR introduce any user-facing change?

How was this patch tested?

Uh oh!

github-actions bot commented Jul 1, 2025

Uh oh!

codecov bot commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

github-actions bot commented Jul 6, 2025

Uh oh!

Uh oh!

Yikun left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Jul 26, 2025

Uh oh!

github-actions bot commented Jul 30, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

leo-pony commented Jul 1, 2025 •

edited by github-actions bot

Loading

codecov bot commented Jul 4, 2025 •

edited

Loading