[RFC]: Enabling Arm Neoverse CI Runners #17720
Description
Motivation.
Add Arm Neoverse runners to the vLLM CI fleet so that every change is automatically built, tested, and benchmarked on Arm hardware.
Motivations
- Confidence on Arm: Current CI does not cover Arm, leaving Arm changes un-validated until after merge.
- Faster feedback: Contributors can catch functional or performance regressions early.
- Broader adoption: Ensures vLLM remains stable for the growing Arm cloud/server ecosystem.
Proposed Change.
Hello vLLM Team,
Arm would like to support the vLLM project by enabling Arm Neoverse CI runners. Currently, there are no Arm-based runners available, which poses a challenge for testing and validating Arm-specific contributions. Enabling these runners would improve the stability and confidence in community-driven changes targeting Arm platforms.
As part of this initiative:
- We will try to provision a set of Arm Neoverse CI runners for use by the vLLM project.
- We will coordinate with the vLLM CI team to hand off access and support integration into the existing CI setup.
We would appreciate your input on the following:
- Feedback from the vLLM team on this proposal.
- Any potential blockers or requirements you foresee for enabling this integration.
We’re excited to collaborate and help improve cross-platform support for vLLM. Looking forward to your thoughts.
Reference: #17112 (review)
Feedback Period.
No response
CC List.
Any Other Things.
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.