[New Model]: Mistral-Nemo #6563
Description
The model to consider.
https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407
The closest model vllm already supports.
- https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/llama.py
- https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/mixtral.py
What's your difficulty of supporting the model you want?
No response