Quantized version of: unsloth/Devstral-Small-2505
Vision support is now available, thanks to work by ngxson.
They found that the original mmproj file from Mistral Small 3.1 is compatible with Devstral Small, enabling basic vision functionality. The compatible mmproj file is included here for those interested in trying it out.
Please note that this is not an official integration, and while it appears to work in practice, results may vary.
'Make knowledge free for everyone'
Made with
- Downloads last month
- 93
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for DevQuasar/unsloth.Devstral-Small-2505-GGUF
Base model
mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Devstral-Small-2505