bartowski
/

Qwen2.5-72B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Qwen2.5-72B-Instruct-GGUF

711 GB

1 contributor

History: 28 commits

bartowski's picture

Upload Qwen2.5-72B-Instruct-Q4_K_M.gguf with huggingface_hub

8aa6811 verified about 1 year ago

Qwen2.5-72B-Instruct-Q5_K_M
Upload folder using huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q6_K
Upload folder using huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q8_0
Upload folder using huggingface_hub about 1 year ago
.gitattributes

3.27 kB

Upload Qwen2.5-72B-Instruct.imatrix with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ1_M.gguf

23.7 GB
xet

Upload Qwen2.5-72B-Instruct-IQ1_M.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ2_M.gguf

29.3 GB
xet

Upload Qwen2.5-72B-Instruct-IQ2_M.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ2_XS.gguf

27.1 GB
xet

Upload Qwen2.5-72B-Instruct-IQ2_XS.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ2_XXS.gguf

25.5 GB
xet

Upload Qwen2.5-72B-Instruct-IQ2_XXS.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ3_M.gguf

35.5 GB
xet

Upload Qwen2.5-72B-Instruct-IQ3_M.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ3_XXS.gguf

31.8 GB
xet

Upload Qwen2.5-72B-Instruct-IQ3_XXS.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-IQ4_XS.gguf

39.7 GB
xet

Upload Qwen2.5-72B-Instruct-IQ4_XS.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q2_K.gguf

29.8 GB
xet

Upload Qwen2.5-72B-Instruct-Q2_K.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q2_K_L.gguf

31 GB
xet

Upload Qwen2.5-72B-Instruct-Q2_K_L.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q3_K_L.gguf

39.5 GB
xet

Upload Qwen2.5-72B-Instruct-Q3_K_L.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q3_K_M.gguf

37.7 GB
xet

Upload Qwen2.5-72B-Instruct-Q3_K_M.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q3_K_S.gguf

34.5 GB
xet

Upload Qwen2.5-72B-Instruct-Q3_K_S.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q3_K_XL.gguf

40.6 GB
xet

Upload Qwen2.5-72B-Instruct-Q3_K_XL.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q4_0.gguf

41.4 GB
xet

Upload Qwen2.5-72B-Instruct-Q4_0.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct-Q4_K_M.gguf

47.4 GB
xet

Upload Qwen2.5-72B-Instruct-Q4_K_M.gguf with huggingface_hub about 1 year ago
Qwen2.5-72B-Instruct.imatrix

25.2 MB
xet

Upload Qwen2.5-72B-Instruct.imatrix with huggingface_hub about 1 year ago
README.md

8.75 kB

Update README.md about 1 year ago