Hugging Face's logo

MaziyarPanahi
/
Qwen2.5-0.5B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files
xet
Community
2
MaziyarPanahi commited on
Commit
32f645b
·
verified ·
1 Parent(s): 4b1c280

8d8e0164dda5f70b6da4723aa9c8b0b7412ce0aaf71fb2793cac1cdefde26a1d

Browse files
Files changed (8) hide show
  1. .gitattributes +6 -0
  2. Qwen2.5-0.5B-Instruct-GGUF_imatrix.dat +0 -0
  3. Qwen2.5-0.5B-Instruct.IQ1_M.gguf +3 -0
  4. Qwen2.5-0.5B-Instruct.IQ1_S.gguf +3 -0
  5. Qwen2.5-0.5B-Instruct.IQ2_XS.gguf +3 -0
  6. Qwen2.5-0.5B-Instruct.IQ3_XS.gguf +3 -0
  7. Qwen2.5-0.5B-Instruct.IQ4_XS.gguf +3 -0
  8. Qwen2.5-0.5B-Instruct.Q2_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-0.5B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-0.5B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-0.5B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-0.5B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-0.5B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-0.5B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-0.5B-Instruct-GGUF_imatrix.dat ADDED
Binary file (989 kB). View file
 
Qwen2.5-0.5B-Instruct.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8a2ad9b8cb4c048e04997afd964630006ec8bddea081f15234154e172189281
3
+ size 317974560
Qwen2.5-0.5B-Instruct.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:901047b5ace32d2c139581147fa03d31eaa3ea57424c7e0585775bdcddd07209
3
+ size 315829536
Qwen2.5-0.5B-Instruct.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88eecc788a8821326f92383a65196b9d93ff91604cce4909a86b7d1022e1a992
3
+ size 324409632
Qwen2.5-0.5B-Instruct.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ab60486ab6f9c117260bf3cd7f6267e0f849ba24fa18ca4af5c8420a02adfe5
3
+ size 338607648
Qwen2.5-0.5B-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ba6761994505291595677b7e022c413040c561713403fab4cf2677347f44119
3
+ size 349402656
Qwen2.5-0.5B-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4b5caaba28dff634c2227b1f54e2e3173482cdc63e6f11a8f4f4103d60ad880
3
+ size 338607648