Mungert
/

KAT-Dev-72B-Exp-GGUF

Model card Files Files and versions

KAT-Dev-72B-Exp-GGUF

972 GB

1 contributor

History: 31 commits

Mungert's picture

Upload bf16/KAT-Dev-72B-Exp-bf16-00004-of-00004.gguf with huggingface_hub

69d3f98 verified 26 days ago

bf16
Upload bf16/KAT-Dev-72B-Exp-bf16-00004-of-00004.gguf with huggingface_hub 26 days ago
q5-1
Upload q5-1/KAT-Dev-72B-Exp-q5_1-q5_1-00002-of-00002.gguf with huggingface_hub 27 days ago
q6-k-m
Upload q6-k-m/KAT-Dev-72B-Exp-q6_k_m-q6_k_m-00002-of-00002.gguf with huggingface_hub 27 days ago
.gitattributes

3.66 kB

Upload bf16/KAT-Dev-72B-Exp-bf16-00004-of-00004.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00001-of-00003.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00001-of-00003.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00002-of-00003.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00002-of-00003.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00003-of-00003.gguf

11.6 GB
xet

Upload KAT-Dev-72B-Exp-f16_q8_0-f16_q8_0-00003-of-00003.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-imatrix.gguf

25.3 MB
xet

Upload KAT-Dev-72B-Exp-imatrix.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq1_m.gguf

25.2 GB
xet

Upload KAT-Dev-72B-Exp-iq1_m.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-iq1_s.gguf

23.6 GB
xet

Upload KAT-Dev-72B-Exp-iq1_s.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-iq2_m.gguf

29.4 GB
xet

Upload KAT-Dev-72B-Exp-iq2_m.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq2_s.gguf

28.1 GB
xet

Upload KAT-Dev-72B-Exp-iq2_s.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-iq2_xs.gguf

27.9 GB
xet

Upload KAT-Dev-72B-Exp-iq2_xs.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-iq2_xxs.gguf

26.3 GB
xet

Upload KAT-Dev-72B-Exp-iq2_xxs.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-iq3_m.gguf

35.3 GB
xet

Upload KAT-Dev-72B-Exp-iq3_m.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq3_xs.gguf

33.2 GB
xet

Upload KAT-Dev-72B-Exp-iq3_xs.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq3_xxs.gguf

32.3 GB
xet

Upload KAT-Dev-72B-Exp-iq3_xxs.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq4_nl.gguf

41 GB
xet

Upload KAT-Dev-72B-Exp-iq4_nl.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-iq4_xs.gguf

40.1 GB
xet

Upload KAT-Dev-72B-Exp-iq4_xs.gguf with huggingface_hub 26 days ago
KAT-Dev-72B-Exp-q4_0.gguf

42.2 GB
xet

Upload KAT-Dev-72B-Exp-q4_0.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-q4_1.gguf

45.6 GB
xet

Upload KAT-Dev-72B-Exp-q4_1.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-q4_k_s.gguf

44.3 GB
xet

Upload KAT-Dev-72B-Exp-q4_k_s.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-q5_0.gguf

50.9 GB
xet

Upload KAT-Dev-72B-Exp-q5_0.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-q8_0-q8_0-00001-of-00002.gguf

45.9 GB
xet

Upload KAT-Dev-72B-Exp-q8_0-q8_0-00001-of-00002.gguf with huggingface_hub 27 days ago
KAT-Dev-72B-Exp-q8_0-q8_0-00002-of-00002.gguf

31.4 GB
xet

Upload KAT-Dev-72B-Exp-q8_0-q8_0-00002-of-00002.gguf with huggingface_hub 27 days ago
README.md

7.41 kB

Upload README.md with huggingface_hub 26 days ago