AngelSlim/DeepSeek-R1-0528_w4a8_fp8
Updated
•
52
•
2
Deepseek-quant
The collection of quantization models of DeepSeek and Deepseek_r1_distill
-
-
AngelSlim/Deepseek_r1_distill_qwen-1_5b_fp8_static
Updated • 13 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_awq
0.6B • Updated • 10 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_gptq
0.6B • Updated • 10 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_awq
3B • Updated • 11 -
AngelSlim/Deepseek_r1_distill_qwen-14b_fp8_static
15B • Updated • 113 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_gptq
3B • Updated • 14 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_gptq
6B • Updated • 19 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_gptq
2B • Updated • 11 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_awq
2B • Updated • 11 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_awq
6B • Updated • 12 -
AngelSlim/Deepseek_r1_distill_qwen-7b_fp8_static
8B • Updated • 16 -
AngelSlim/Deepseek_r1_distill_qwen-32b_fp8_static
33B • Updated • 29