[TRTLLM-5589] feat: Minor optimizations for tunable FP8 batched GEMM op.

[hyukn]

Revise some implementations in the tunable FP8 batched GEMM op to reduce Python overhead for the original #4872.
The class TuningConfig is hashable so that the same contents will be converted to the same hash value. This will not cause any cache key miss. But it can introduce extra overheads for the inference phase.

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #8578 [ run ] triggered by Bot

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #8600 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #8600 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6241 completed with status: 'ABORTED'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #8724 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #8724 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6328 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #8950 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #8950 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6530 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #8995 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #8995 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6567 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9071 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9071 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6633 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9083 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9083 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6645 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9116 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9116 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6670 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9183 [ run ] triggered by Bot

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9197 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9183 [ run ] completed with state ABORTED
/LLM/main/L0_MergeRequest_PR pipeline #6728 completed with status: 'FAILURE'

[DomBrown]

/bot run

[tensorrt-cicd]

PR_Github #9233 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9233 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #6771 completed with status: 'FAILURE'

[DomBrown]

/bot run

[tensorrt-cicd]

PR_Github #9242 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9242 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6779 completed with status: 'FAILURE'

[hyukn]

/bot run

[tensorrt-cicd]

PR_Github #9263 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #9263 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #6796 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.