[Bugfix][Hardware][Intel CPU] Fix unpassed multi_modal_kwargs for CPU runner (vllm-project#5956)

Isotr0py · Robert Shaw · commit f177c041ad68 · 2024-07-01T02:08:49.000Z
diff --git a/vllm/worker/cpu_model_runner.py b/vllm/worker/cpu_model_runner.py
@@ -355,6 +355,7 @@ def prepare_model_input(
             input_positions=input_positions,
             attn_metadata=attn_metadata,
             sampling_metadata=sampling_metadata,
+            multi_modal_kwargs=multi_modal_kwargs,
         )
 
     @torch.inference_mode()

Original file line number	Diff line number	Diff line change
`@@ -355,6 +355,7 @@ def prepare_model_input(`
`355`	`355`	`input_positions=input_positions,`
`356`	`356`	`attn_metadata=attn_metadata,`
`357`	`357`	`sampling_metadata=sampling_metadata,`
	`358`	`+ multi_modal_kwargs=multi_modal_kwargs,`
`358`	`359`	`)`
`359`	`360`
`360`	`361`	`@torch.inference_mode()`