[New Model]: Supporting DBRX from Databricks #3658
Description
The model to consider.
Databricks has released DBRX, which consists of 2 models
It's a 132B parameter MoE model. Might be useful.
The closest model vllm already supports.
No response
What's your difficulty of supporting the model you want?
It seems that they have a custom script in their files, might need custom implementation on that regard.