Skip to content

Commit 9fb4585

Browse files
committed
chore(model gallery): add mistralai_mistral-small-3.1-24b-instruct-2503
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 27a3997 commit 9fb4585

File tree

1 file changed

+17
-0
lines changed

1 file changed

+17
-0
lines changed

gallery/index.yaml

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8585,6 +8585,23 @@
85858585
- filename: BeaverAI_MN-2407-DSK-QwQify-v0.1-12B-Q4_K_M.gguf
85868586
uri: huggingface://bartowski/BeaverAI_MN-2407-DSK-QwQify-v0.1-12B-GGUF/BeaverAI_MN-2407-DSK-QwQify-v0.1-12B-Q4_K_M.gguf
85878587
sha256: f6ae7dd8be3aedd640483ccc6895c3fc205a019246bf2512a956589c0222386e
8588+
- !!merge <<: *mistral03
8589+
name: "mistralai_mistral-small-3.1-24b-instruct-2503"
8590+
urls:
8591+
- https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503
8592+
- https://huggingface.co/bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF
8593+
description: |
8594+
Building upon Mistral Small 3 (2501), Mistral Small 3.1 (2503) adds state-of-the-art vision understanding and enhances long context capabilities up to 128k tokens without compromising text performance. With 24 billion parameters, this model achieves top-tier capabilities in both text and vision tasks.
8595+
This model is an instruction-finetuned version of: Mistral-Small-3.1-24B-Base-2503.
8596+
8597+
Mistral Small 3.1 can be deployed locally and is exceptionally "knowledge-dense," fitting within a single RTX 4090 or a 32GB RAM MacBook once quantized.
8598+
overrides:
8599+
parameters:
8600+
model: mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
8601+
files:
8602+
- filename: mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
8603+
sha256: c5743c1bf39db0ae8a5ade5df0374b8e9e492754a199cfdad7ef393c1590f7c0
8604+
uri: huggingface://bartowski/mistralai_Mistral-Small-3.1-24B-Instruct-2503-GGUF/mistralai_Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf
85888605
- &mudler
85898606
url: "github:mudler/LocalAI/gallery/mudler.yaml@master" ### START mudler's LocalAI specific-models
85908607
name: "LocalAI-llama3-8b-function-call-v0.2"

0 commit comments

Comments
 (0)