-
-
Notifications
You must be signed in to change notification settings - Fork 11k
[Misc] Deprecation Warning when setting --engine-use-ray #7424
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Misc] Deprecation Warning when setting --engine-use-ray #7424
Conversation
Signed-off-by: Wallas Santos <[email protected]>
|
👋 Hi! Thank you for contributing to the vLLM project. Once the PR is approved and ready to go, please make sure to run full CI as it is required to merge (or just use auto-merge). To run full CI, you can do one of these:
🚀 |
| self.log_requests = log_requests | ||
| self.engine = self._init_engine(*args, **kwargs) | ||
|
|
||
| if self.engine_use_ray: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can hard fail here, and put an env var to turn it on with a warning.
something like:
if self.engine_use_ray:
if envs.VLLM_ALLOW_ENGINE_USE_RAY:
# print warning
else:
# directly error, with the error message pointing to the RFC issuefor the link, please use full url.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for your comment @youkaichao. I added modifications to address your suggestions.
…e, env VLLM_ALLOW_ENGINE_USE_RAY allows to force use it Signed-off-by: Wallas Santos <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks for the contribution!
|
Thanks @wallashss! Unfortunately some of the tests make use of this arg, we should update the tests to not use it. If we want to get this PR merged in the meantime, we'll have to include changes to add the override env var to the tests in question. |
|
we can run these tests with the override env var. we don't need to remove them right now. |
…ion as deprecated feature Signed-off-by: Wallas Santos <[email protected]>
I think it is mostly tests for other things that make use of |
…RAY=1 to not raise exception Signed-off-by: Wallas Santos <[email protected]>
…Y=1 to not raise exception Signed-off-by: Wallas Santos <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @wallashss... just some minor change suggestions to the wording
Co-authored-by: Nick Hill <[email protected]>
Co-authored-by: Nick Hill <[email protected]>
Co-authored-by: Nick Hill <[email protected]>
|
hope @wallashss put the env var in all relevant places and the full test can pass 😉 |
Signed-off-by: Wallas Santos <[email protected]>
I hope so too! I checked the tests and after several fixes, I did not find errors related to my changes. Right now I solved a conflict and a code format error. I guess that will be ready in the next round of checks. |
|
tests look unrelated. merging. |
|
Thank you @youkaichao! |
…t#7424) Signed-off-by: Wallas Santos <[email protected]> Co-authored-by: youkaichao <[email protected]> Co-authored-by: Nick Hill <[email protected]> Co-authored-by: youkaichao <[email protected]> Signed-off-by: Alvant <[email protected]>
…t#7424) Signed-off-by: Wallas Santos <[email protected]> Co-authored-by: youkaichao <[email protected]> Co-authored-by: Nick Hill <[email protected]> Co-authored-by: youkaichao <[email protected]> Signed-off-by: LeiWang1999 <[email protected]>
Fix #7045
This PR adds a deprecation warning when users set
--engine-use-ray.For a concise message, I added in the message the issue number for additional clarification.