tensorblock
/

DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF

Model card Files Files and versions

DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF

71.2 MB

1 contributor

History: 2 commits

morriszms's picture

Upload folder using huggingface_hub

49c2a31 verified 9 months ago

.gitattributes

2.61 kB

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q2_K.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_L.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_M.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_S.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_0.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_M.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q4_K_S.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_0.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_M.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q5_K_S.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q6_K.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q8_0.gguf

5.93 MB
xet

Upload folder using huggingface_hub 9 months ago
README.md

5.92 kB

Upload folder using huggingface_hub 9 months ago