Skip to content

Commit 3c7a6d5

Browse files
authored
Turn on custom allreduce by default in O3 (#2706)
1 parent da06a06 commit 3c7a6d5

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

python/mlc_llm/interface/compiler_flags.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -205,5 +205,6 @@ def from_str(source: str) -> "ModelConfigOverride":
205205
faster_transformer=True,
206206
cudagraph=True,
207207
cutlass=True,
208+
ipc_allreduce_strategy=IPCAllReduceStrategyType.AUTO,
208209
),
209210
}

0 commit comments

Comments
 (0)