Hugging Face's logo

ggml-org
/
Devstral-Small-2-24B-Instruct-2512-GGUF

GGUF
conversational
Model card Files
xet
Community

Devstral-Small-2-24B-Instruct-2512 GGUF

Recommended way to run this model:

llama-server -hf ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF -c 0

Then, access http://localhost:8080

Downloads last month
1,043
GGUF
Model size
24B params
Architecture
mistral3
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Quantized
mistralai/Devstral-Small-2-24B-Instruct-2512
Quantized
(25)
this model

Collection including ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF