Skip to content

Add testing for trtllm-llmapi-launch with tritonserver #5528

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 27, 2025
Merged

Add testing for trtllm-llmapi-launch with tritonserver #5528

merged 1 commit into from
Jun 27, 2025

Conversation

Tabrizian
Copy link
Member

Add testing for trtllm-llmapi-launch with tritonserver

@Tabrizian
Copy link
Member Author

/bot run --stage-list "DGX_H100-4_GPUs-Triton-1"

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10071 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10071 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7435 (Partly Tested) completed with status: 'FAILURE'

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from 5ddb31a to ef8d2bb Compare June 26, 2025 23:33
@Tabrizian
Copy link
Member Author

/bot run --stage-list "DGX_H100-4_GPUs-Triton-1"

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10074 [ run ] triggered by Bot

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from ef8d2bb to a9366d7 Compare June 26, 2025 23:39
@Tabrizian
Copy link
Member Author

/bot run --stage-list "DGX_H100-4_GPUs-Triton-1"

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from a9366d7 to 936a461 Compare June 26, 2025 23:40
@tensorrt-cicd
Copy link
Collaborator

PR_Github #10076 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10074 [ run ] completed with state ABORTED

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10076 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7440 (Partly Tested) completed with status: 'FAILURE'

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from 936a461 to 4312001 Compare June 27, 2025 00:46
@Tabrizian
Copy link
Member Author

/bot run --stage-list "DGX_H100-4_GPUs-Triton-1"

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from 1f15a29 to 73d1e98 Compare June 27, 2025 00:48
@tensorrt-cicd
Copy link
Collaborator

PR_Github #10081 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10081 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #7444 (Partly Tested) completed with status: 'FAILURE'

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from 73d1e98 to 44b6237 Compare June 27, 2025 01:38
@Tabrizian
Copy link
Member Author

/bot run --stage-list "DGX_H100-4_GPUs-Triton-[Post-Merge]-1"

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10084 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10084 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7447 (Partly Tested) completed with status: 'SUCCESS'

@Tabrizian Tabrizian force-pushed the user/imant/backendllmapi branch from 44b6237 to 4617d2d Compare June 27, 2025 03:06
@Tabrizian
Copy link
Member Author

/bot reuse-pipeline

@Tabrizian Tabrizian enabled auto-merge (squash) June 27, 2025 03:06
@tensorrt-cicd
Copy link
Collaborator

PR_Github #10097 [ reuse-pipeline ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #10097 [ reuse-pipeline ] completed with state SUCCESS
Reusing PR_Github #10084 (Partly Tested) for commit 4617d2d

@Tabrizian Tabrizian merged commit 49af791 into NVIDIA:main Jun 27, 2025
3 checks passed
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 9, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
0e18ac6 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
e93a038 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
8ba3687 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
d75eaa0 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
5e01d94 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
260d45e 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
3dc6565 
Signed-off-by: Iman Tabrizian <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@Tabrizian @dominicshanshan
Add testing for trtllm-llmapi-launch with tritonserver (NVIDIA#5528)
3f570a4 
Signed-off-by: Iman Tabrizian <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@achartier achartier achartier approved these changes

@pcastonguay pcastonguay Awaiting requested review from pcastonguay

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Tabrizian @tensorrt-cicd @achartier