Skip to content

Commit 6a9e87b

Browse files
Evrard-Nilsimon-mo
andauthored
Add function calling support to DeepSeek-V3.1 usage guide. (#61)
Signed-off-by: Evrard-Nil Daillet <[email protected]> Co-authored-by: Simon Mo <[email protected]>
1 parent 4ff3061 commit 6a9e87b

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

DeepSeek/DeepSeek-V3_1.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,17 @@ vllm serve deepseek-ai/DeepSeek-V3.1 \
2626
--served-model-name ds31
2727
```
2828

29+
### Function calling
30+
31+
vLLM also supports calling user-defined functions. Make sure to run your DeepSeek-V3.1 models with the following arguments. The example file is included in the official container and can be downloaded [here](https://github.com/vllm-project/vllm/blob/main/examples/tool_chat_template_deepseekv31.jinja)
32+
33+
```bash
34+
vllm serve ...
35+
--enable-auto-tool-choice
36+
--tool-call-parser deepseek_v31
37+
--chat-template examples/tool_chat_template_deepseekv31.jinja
38+
```
39+
2940
## Using the Model
3041

3142
### OpenAI Client Example

0 commit comments

Comments
 (0)