-
Notifications
You must be signed in to change notification settings - Fork 1.8k
[5310329] fix: Fix warmup phase batch size out of range. #4912
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
/bot run |
PR_Github #7511 [ run ] triggered by Bot |
PR_Github #7511 [ run ] completed with state |
e620c09
to
ff59276
Compare
/bot run |
PR_Github #7524 [ run ] triggered by Bot |
PR_Github #7524 [ run ] completed with state |
/bot run |
PR_Github #7548 [ run ] triggered by Bot |
PR_Github #7548 [ run ] completed with state |
/bot run |
PR_Github #7591 [ run ] triggered by Bot |
PR_Github #7591 [ run ] completed with state |
322b26d
to
5f6bbbb
Compare
/bot run |
PR_Github #7652 [ run ] triggered by Bot |
PR_Github #7652 [ run ] completed with state |
/bot run |
PR_Github #7708 [ run ] triggered by Bot |
PR_Github #7708 [ run ] completed with state |
Signed-off-by: Yukun He <[email protected]>
Based on the successful run before rebase, I will reuse the pipeline. |
/bot reuse-pipeline |
PR_Github #7830 [ reuse-pipeline ] triggered by Bot |
PR_Github #7830 [ reuse-pipeline ] completed with state |
Signed-off-by: Yukun He <[email protected]>
This is due to the number of autotuning warmup requests exceeding the limit of max_batch_size. This PR will limit the batch size according to multiple size constraints.
Autotuning is disabled due to a race condition that was triggered in the CI. This can be fixed by #4565. This has been locally checked on main. Will enable the config on the main after being merged.