eaddario
/

DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation

Model card Files Files and versions

DeepSeek-R1-Distill-Qwen-7B-GGUF

112 GB

1 contributor

History: 72 commits

eaddario's picture

Layer-wise quantization Q8_0

a5eeb40 verified 7 months ago

imatrix
Regenerate importance matrices 7 months ago
logits
Regenerate logits 7 months ago
scores
Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
.gitattributes

1.65 kB

Update lfs attributes and ignores 9 months ago
.gitignore

6.78 kB

Update lfs attributes and ignores 9 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.gguf

15.2 GB
xet

Rename to F16 9 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.gguf

3.29 GB
xet

Selective quantization IQ3_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.gguf

3.09 GB
xet

Selective quantization IQ3_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.gguf

4.09 GB
xet

Selective quantization IQ4_NL 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.gguf

3.23 GB
xet

Selective quantization Q3_K_L 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.gguf

3.18 GB
xet

Selective quantization Q3_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.gguf

3.12 GB
xet

Selective quantization Q3_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf

4.22 GB
xet

Selective quantization Q4_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.gguf

4.1 GB
xet

Selective quantization Q4_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.gguf

5.06 GB
xet

Selective quantization Q5_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.gguf

4.92 GB
xet

Selective quantization Q5_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf

5.81 GB
xet

Selective quantization Q6_K 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.gguf

7.27 GB
xet

Layer-wise quantization Q8_0 7 months ago
README.md

19.1 kB

Update README.md 7 months ago