- 
          
- 
        Couldn't load subscription status. 
- Fork 10.8k
Closed
Labels
new-modelRequests to new modelsRequests to new models
Description
The model to consider.
https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407
The closest model vllm already supports.
- https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/llama.py
- https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/mixtral.py
What's your difficulty of supporting the model you want?
No response
AntoninLeroy and jorgemcgomesAntoninLeroy
Metadata
Metadata
Assignees
Labels
new-modelRequests to new modelsRequests to new models