Mungert
/

KAT-Dev-72B-Exp-GGUF

Model card Files Files and versions

KAT-Dev-72B-Exp-GGUF

678 GB

1 contributor

History: 21 commits

Mungert's picture

Upload KAT-Dev-72B-Exp-iq3_xs.gguf with huggingface_hub

f4d777d verified 30 days ago

q5-1
Upload q5-1/KAT-Dev-72B-Exp-q5_1-q5_1-00002-of-00002.gguf with huggingface_hub about 1 month ago
q6-k-m
Upload q6-k-m/KAT-Dev-72B-Exp-q6_k_m-q6_k_m-00002-of-00002.gguf with huggingface_hub about 1 month ago
.gitattributes

3.01 kB

Upload KAT-Dev-72B-Exp-iq3_xs.gguf with huggingface_hub 30 days ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00001-of-00003.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00001-of-00003.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00002-of-00003.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00002-of-00003.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00003-of-00003.gguf

11.6 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00003-of-00003.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq1_m.gguf

25.2 GB
xet

Upload KAT-Dev-72B-Exp-iq1_m.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq1_s.gguf

23.6 GB
xet

Upload KAT-Dev-72B-Exp-iq1_s.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq2_m.gguf

29.4 GB
xet

Upload KAT-Dev-72B-Exp-iq2_m.gguf with huggingface_hub 30 days ago
KAT-Dev-72B-Exp-iq2_s.gguf

28.1 GB
xet

Upload KAT-Dev-72B-Exp-iq2_s.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq2_xs.gguf

27.9 GB
xet

Upload KAT-Dev-72B-Exp-iq2_xs.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq2_xxs.gguf

26.3 GB
xet

Upload KAT-Dev-72B-Exp-iq2_xxs.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-iq3_xs.gguf

33.2 GB
xet

Upload KAT-Dev-72B-Exp-iq3_xs.gguf with huggingface_hub 30 days ago
KAT-Dev-72B-Exp-q4_0.gguf

42.2 GB
xet

Upload KAT-Dev-72B-Exp-q4_0.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-q4_1.gguf

45.6 GB
xet

Upload KAT-Dev-72B-Exp-q4_1.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-q4_k_s.gguf

44.3 GB
xet

Upload KAT-Dev-72B-Exp-q4_k_s.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-q5_0.gguf

50.9 GB
xet

Upload KAT-Dev-72B-Exp-q5_0.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-q8_0-q8_0-00001-of-00002.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-q8_0-q8_0-00001-of-00002.gguf with huggingface_hub about 1 month ago
KAT-Dev-72B-Exp-q8_0-q8_0-00002-of-00002.gguf

31.4 GB
xet

Upload KAT-Dev-72B-Exp-q8_0-q8_0-00002-of-00002.gguf with huggingface_hub about 1 month ago