Skip to content

Enable tool calling for Deepseek V3.1, DeepSeek-R1-0528 and Kimi-K2 #2067

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 14 commits into from
Oct 29, 2025
Merged

Enable tool calling for Deepseek V3.1, DeepSeek-R1-0528 and Kimi-K2 #2067

merged 14 commits into from
Oct 29, 2025

Conversation

@huiqiwa
Copy link

@huiqiwa huiqiwa commented Oct 22, 2025 •
edited by github-actions bot
Loading

  • Added full support for tool_choice="required" in the chat and tool-calling flow.
  • Added tool parser files for DeepSeekV3.1, DeepSeek-R1-0528, and Kimi-K2.

meffmadd and others added 14 commits October 21, 2025 08:12
@meffmadd @liangfu
@mgoin @huiqiwa
[Frontend] Implement Tool Calling with tool_choice='required' (vllm…
38d80db 
…-project#13483)

Signed-off-by: Liangfu Chen <[email protected]>
Signed-off-by: Matt, Matthias <[email protected]>
Co-authored-by: Liangfu Chen <[email protected]>
Co-authored-by: mgoin <[email protected]>
@Xu-Wenqing @huiqiwa
[Feature] Support DeepSeekV3 Function Call (vllm-project#17784)
4658fa9 
Signed-off-by: 许文卿 <[email protected]>
Signed-off-by: Xu Wenqing <[email protected]>
@maxdebayser @iGmainC @huiqiwa
Initialize the delta tool call fields explicitly (vllm-project#17340)
111fe14 
Signed-off-by: Max de Bayser <[email protected]>
Co-authored-by: igmainc <[email protected]>
@Xu-Wenqing @huiqiwa
Add DeepSeek-R1-0528 function call chat template (vllm-project#18874)
2986c18 
Signed-off-by: 许文卿 <[email protected]>
@chaunceyjiang @huiqiwa
[Bugfix] fix missing 'finish_reason': null in streaming chat (vllm-pr…
fd3a5e8 
…oject#19662)

Signed-off-by: chaunceyjiang <[email protected]>
@reidliu41 @huiqiwa
[Misc] call the pre-defined func (vllm-project#20518)
352241b 
Signed-off-by: reidliu41 <[email protected]>
@chaunceyjiang @huiqiwa
[Frontend] Support Tool Calling with both tool_choice='required' an…
cd6a994 
…d `$defs`. (vllm-project#20629)

Signed-off-by: chaunceyjiang <[email protected]>
@sfbemerk @huiqiwa
Fix DeepSeek-R1-0528 chat template (vllm-project#20717)
65da636 
Signed-off-by: Benjamin Merkel <[email protected]>
Co-authored-by: Benjamin Merkel <[email protected]>
@MoyanZitto @huiqiwa
Add kimi-k2 tool parser (vllm-project#20789)
a0884fd 
Signed-off-by: wangzhengtao <[email protected]>
Co-authored-by: wangzhengtao <[email protected]>
Co-authored-by: wangzhengtao <[email protected]>
@tlipoca9 @huiqiwa
fix: kimi_k2 return empty tool call list (vllm-project#22149)
3e8006f 
Signed-off-by: tlipoca9 <[email protected]>
@MoyanZitto @huiqiwa
[Fix] correct tool_id for kimi-k2 when use tool_choice=required (vllm…
fffbdff 
…-project#21259)

Co-authored-by: wangzhengtao <[email protected]>
@Xu-Wenqing @huiqiwa
Support DeepSeek-V3.1 tool call (vllm-project#23454)
53eaf9a 
Signed-off-by: Xu Wenqing <[email protected]>
@skyloevil @huiqiwa
[Fix] DeepSeek V3.1 tool parser error message (vllm-project#23492)
2f323d0 
Signed-off-by: zitian.zhao <[email protected]>
@taohui @huiqiwa
[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools …
ca5be48 
…in non-streaming output (vllm-project#25405)

Signed-off-by: taohui <[email protected]>
@huiqiwa huiqiwa changed the title Support tool calling for Deepseek V3.1, DeepSeek-R1-0528 and Kimi-K2 Enable tool calling for Deepseek V3.1, DeepSeek-R1-0528 and Kimi-K2 Oct 24, 2025
@huiqiwa
Copy link
Author

huiqiwa commented Oct 24, 2025 •
edited
Loading

@czhu15 @yangulei @taotod
Please help review.

@taotod
Copy link

taotod commented Oct 27, 2025

@ccrhx4， please help review this PR. Thanks.

@ccrhx4
Copy link

ccrhx4 commented Oct 29, 2025

LGTM @czhu15 please help to merge.

@czhu15 czhu15 merged commit c3f513e into HabanaAI:deepseek_r1 Oct 29, 2025
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kzawora-intel kzawora-intel Awaiting requested review from kzawora-intel kzawora-intel is a code owner

@michalkuligowski michalkuligowski Awaiting requested review from michalkuligowski michalkuligowski is a code owner

@mgawarkiewicz mgawarkiewicz Awaiting requested review from mgawarkiewicz mgawarkiewicz is a code owner

@vivekgoe vivekgoe Awaiting requested review from vivekgoe vivekgoe is a code owner

@afierka-intel afierka-intel Awaiting requested review from afierka-intel afierka-intel is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.