eaddario
/

Mistral-Small-3.2-24B-Instruct-2506-GGUF

Text Generation

Model card Files Files and versions

Mistral-Small-3.2-24B-Instruct-2506-GGUF

248 GB

1 contributor

History: 26 commits

eaddario's picture

Update README.md

8f92747 verified 4 months ago

imatrix
Generate imatrices 4 months ago
logits
Generate base model logits 4 months ago
scores
Generate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 4 months ago
.gitattributes

1.6 kB

Update .gitattributes 4 months ago
.gitignore

6.78 kB

Add .gitignore 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-F16.gguf

47.2 GB
xet

Convert safetensor to GGUF @ F16 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-IQ3_M.gguf

10.8 GB
xet

Layer-wise quantization IQ3_M 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-IQ3_S.gguf

9.79 GB
xet

Layer-wise quantization IQ3_S 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-IQ4_NL.gguf

13.1 GB
xet

Layer-wise quantization IQ4_NL 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_L.gguf

11.4 GB
xet

Layer-wise quantization Q3_K_L 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_M.gguf

10.4 GB
xet

Layer-wise quantization Q3_K_M 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_S.gguf

9.19 GB
xet

Layer-wise quantization Q3_K_S 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf

13.1 GB
xet

Layer-wise quantization Q4_K_M 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf

11.9 GB
xet

Layer-wise quantization Q4_K_S 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q5_K_M.gguf

16 GB
xet

Layer-wise quantization Q5_K_M 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q5_K_S.gguf

14.9 GB
xet

Layer-wise quantization Q5_K_S 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q6_K.gguf

19.8 GB
xet

Layer-wise quantization Q6_K 4 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q8_0.gguf

20.8 GB
xet

Layer-wise quantization Q8_0 4 months ago
README.md

23.1 kB

Update README.md 4 months ago