Skip to content

[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. #5394

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 26, 2025
Merged

[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. #5394

merged 1 commit into from
Jun 26, 2025

Conversation

@hyukn
Copy link
Collaborator

@hyukn hyukn commented Jun 21, 2025

Remove the tuning process for the cutlass fused moe path under min_latency_mode.

@hyukn hyukn requested a review from hlu1 June 21, 2025 13:26
@hyukn hyukn requested a review from a team as a code owner June 21, 2025 13:26
@hyukn hyukn requested a review from liji-nv June 21, 2025 13:26
@hyukn
Copy link
Collaborator Author

hyukn commented Jun 21, 2025

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9573 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9573 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #7031 completed with status: 'FAILURE'

@hyukn hyukn force-pushed the feat/remove_min_latency_mode_autotune branch from e48de61 to e4925e8 Compare June 22, 2025 00:46
@hyukn
Copy link
Collaborator Author

hyukn commented Jun 22, 2025

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9578 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9578 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7034 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

hlu1
hlu1 approved these changes Jun 24, 2025
View reviewed changes
@hyukn hyukn force-pushed the feat/remove_min_latency_mode_autotune branch from e4925e8 to a735b93 Compare June 25, 2025 09:12
@hyukn
Copy link
Collaborator Author

hyukn commented Jun 25, 2025

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9856 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9856 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7270 completed with status: 'FAILURE'

@hyukn hyukn force-pushed the feat/remove_min_latency_mode_autotune branch from a735b93 to 54dbf26 Compare June 26, 2025 01:55
@hyukn
Copy link
Collaborator Author

hyukn commented Jun 26, 2025

/bot run

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9944 [ run ] triggered by Bot

@tensorrt-cicd
Copy link
Collaborator

PR_Github #9944 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #7336 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

@hyukn hyukn merged commit 9ee3360 into NVIDIA:main Jun 26, 2025
3 checks passed
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 9, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
d3c3701 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
5f2815f 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
6835cb3 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
22527ea 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 10, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
f3d1349 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
61fc9b2 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
bf8438b 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
dominicshanshan pushed a commit to dominicshanshan/TensorRT-LLM that referenced this pull request Jul 11, 2025
@hyukn @dominicshanshan
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner. (N…
0513b92 
…VIDIA#5394)

Signed-off-by: Yukun He <[email protected]>
@hyukn hyukn deleted the feat/remove_min_latency_mode_autotune branch October 31, 2025 09:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@hlu1 hlu1 hlu1 approved these changes

@liji-nv liji-nv Awaiting requested review from liji-nv liji-nv was automatically assigned from NVIDIA/trt-llm-torch-devs

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@hyukn @tensorrt-cicd @hlu1