Skip to content

Conversation

@wallashss
Copy link
Contributor

Fix #7045

This PR adds a deprecation warning when users set --engine-use-ray.
For a concise message, I added in the message the issue number for additional clarification.

Signed-off-by: Wallas Santos <[email protected]>
@github-actions
Copy link

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which consists a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of default ones by unblocking the steps in your fast-check build on Buildkite UI.

Once the PR is approved and ready to go, please make sure to run full CI as it is required to merge (or just use auto-merge).

To run full CI, you can do one of these:

  • Comment /ready on the PR
  • Add ready label to the PR
  • Enable auto-merge.

🚀

self.log_requests = log_requests
self.engine = self._init_engine(*args, **kwargs)

if self.engine_use_ray:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can hard fail here, and put an env var to turn it on with a warning.

something like:

if self.engine_use_ray:
    if envs.VLLM_ALLOW_ENGINE_USE_RAY:
        # print warning
    else:
        # directly error, with the error message pointing to the RFC issue

for the link, please use full url.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your comment @youkaichao. I added modifications to address your suggestions.

…e, env VLLM_ALLOW_ENGINE_USE_RAY allows to force use it

Signed-off-by: Wallas Santos <[email protected]>
Copy link
Member

@youkaichao youkaichao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for the contribution!

@njhill
Copy link
Member

njhill commented Aug 12, 2024

Thanks @wallashss!

Unfortunately some of the tests make use of this arg, we should update the tests to not use it.

If we want to get this PR merged in the meantime, we'll have to include changes to add the override env var to the tests in question.

@youkaichao
Copy link
Member

we can run these tests with the override env var. we don't need to remove them right now.

…ion as deprecated feature

Signed-off-by: Wallas Santos <[email protected]>
@njhill
Copy link
Member

njhill commented Aug 13, 2024

we can run these tests with the override env var. we don't need to remove them right now.

I think it is mostly tests for other things that make use of --engine-use-ray rather than tests for this option in itself, so we'll probably want to rework rather than remove them (agree that can be follow-on work though).

Copy link
Member

@njhill njhill left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @wallashss... just some minor change suggestions to the wording

@youkaichao youkaichao added the ready ONLY add when PR is ready to merge/full CI is needed label Aug 13, 2024
@njhill njhill mentioned this pull request Aug 13, 2024
@youkaichao
Copy link
Member

hope @wallashss put the env var in all relevant places and the full test can pass 😉

@wallashss
Copy link
Contributor Author

hope @wallashss put the env var in all relevant places and the full test can pass 😉

I hope so too! I checked the tests and after several fixes, I did not find errors related to my changes. Right now I solved a conflict and a code format error. I guess that will be ready in the next round of checks.

@youkaichao
Copy link
Member

tests look unrelated. merging.

@youkaichao youkaichao enabled auto-merge (squash) August 14, 2024 16:44
@youkaichao youkaichao disabled auto-merge August 14, 2024 16:44
@youkaichao youkaichao merged commit 70b746e into vllm-project:main Aug 14, 2024
@wallashss
Copy link
Contributor Author

Thank you @youkaichao!

Alvant pushed a commit to compressa-ai/vllm that referenced this pull request Oct 26, 2024
…t#7424)

Signed-off-by: Wallas Santos <[email protected]>
Co-authored-by: youkaichao <[email protected]>
Co-authored-by: Nick Hill <[email protected]>
Co-authored-by: youkaichao <[email protected]>
Signed-off-by: Alvant <[email protected]>
LeiWang1999 pushed a commit to LeiWang1999/vllm-bitblas that referenced this pull request Mar 26, 2025
…t#7424)

Signed-off-by: Wallas Santos <[email protected]>
Co-authored-by: youkaichao <[email protected]>
Co-authored-by: Nick Hill <[email protected]>
Co-authored-by: youkaichao <[email protected]>
Signed-off-by: LeiWang1999 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[RFC]: Deprecation and removal for --engine-use-ray

3 participants