ThomasBaruzier
/

Qwen2.5-0.5B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Qwen2.5-0.5B-Instruct-GGUF

9.57 GB

2 contributors

History: 31 commits

ThomasBaruzier's picture

Upload Qwen2.5-0.5B-Instruct-Q4_1.gguf

de8b8a0 verified about 1 year ago

.gitattributes

3.25 kB

Upload Qwen2.5-0.5B-Instruct-Q4_1.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-F16.gguf

994 MB
xet

Upload Qwen2.5-0.5B-Instruct-F16.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ1_M.gguf

318 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ1_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ1_S.gguf

316 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ1_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ2_M.gguf

329 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ2_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ2_S.gguf

326 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ2_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ2_XS.gguf

324 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ2_XS.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ2_XXS.gguf

322 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ2_XXS.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ3_M.gguf

343 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ3_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ3_S.gguf

339 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ3_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ3_XS.gguf

339 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ3_XS.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ3_XXS.gguf

334 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ3_XXS.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ4_NL.gguf

353 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ4_NL.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-IQ4_XS.gguf

349 MB
xet

Upload Qwen2.5-0.5B-Instruct-IQ4_XS.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q2_K.gguf

339 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q2_K.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q2_K_S.gguf

331 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q2_K_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q3_K_L.gguf

369 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q3_K_L.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q3_K_M.gguf

355 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q3_K_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q3_K_S.gguf

338 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q3_K_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q4_0.gguf

353 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q4_0.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q4_1.gguf

375 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q4_1.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q4_K_M.gguf

398 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q4_K_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q4_K_S.gguf

385 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q4_K_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q5_K_M.gguf

420 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q5_K_M.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q5_K_S.gguf

413 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q5_K_S.gguf about 1 year ago
Qwen2.5-0.5B-Instruct-Q6_K.gguf

506 MB
xet

Upload Qwen2.5-0.5B-Instruct-Q6_K.gguf about 1 year ago
README.md

7.84 kB

Update README.md about 1 year ago
calibration_datav3.txt

280 kB

Upload calibration_datav3.txt about 1 year ago
imatrix.dat

989 kB

Upload imatrix.dat about 1 year ago
perplexity.md

871 Bytes

Upload perplexity.md about 1 year ago