Hugging Face's logo

prithivMLmods
/
Qwen3-VL-8B-Abliterated-Caption-it-GGUF

Image-Text-to-Text
Transformers
GGUF
English
Chinese
Thai
qwen3_vl
text-generation-inference
uncensored
image-captioning
vlm
visual-understanding
caption
image-to-text
conversational
Model card Files
xet
Community
prithivMLmods commited on
Commit
b1fc819
·
verified ·
1 Parent(s): edce324

Upload folder using huggingface_hub

Browse files
Files changed (27) hide show
  1. .gitattributes +33 -8
  2. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_M.gguf +3 -0
  3. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_S.gguf +3 -0
  4. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_M.gguf +3 -0
  5. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_S.gguf +3 -0
  6. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XS.gguf +3 -0
  7. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XXS.gguf +3 -0
  8. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_M.gguf +3 -0
  9. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_S.gguf +3 -0
  10. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XS.gguf +3 -0
  11. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XXS.gguf +3 -0
  12. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_NL.gguf +3 -0
  13. Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_XS.gguf +3 -0
  14. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K.gguf +3 -0
  15. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K_S.gguf +3 -0
  16. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_L.gguf +3 -0
  17. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_M.gguf +3 -0
  18. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_S.gguf +3 -0
  19. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_0.gguf +3 -0
  20. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_1.gguf +3 -0
  21. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_M.gguf +3 -0
  22. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_S.gguf +3 -0
  23. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_M.gguf +3 -0
  24. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_S.gguf +3 -0
  25. Qwen3-VL-8B-Abliterated-Caption-it.i1-Q6_K.gguf +3 -0
  26. Qwen3-VL-8B-Abliterated-Caption-it.imatrix.gguf +3 -0
  27. README.md +98 -0
.gitattributes CHANGED
@@ -33,17 +33,42 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
- Qwen3-VL-8B-Abliterated-Caption-it.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
- Qwen3-VL-8B-Abliterated-Caption-it.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
38
- Qwen3-VL-8B-Abliterated-Caption-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  Qwen3-VL-8B-Abliterated-Caption-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
40
- Qwen3-VL-8B-Abliterated-Caption-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
41
- Qwen3-VL-8B-Abliterated-Caption-it.f16.gguf filter=lfs diff=lfs merge=lfs -text
42
  Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
- Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
45
  Qwen3-VL-8B-Abliterated-Caption-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
- Qwen3-VL-8B-Abliterated-Caption-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
  Qwen3-VL-8B-Abliterated-Caption-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
48
- Qwen3-VL-8B-Abliterated-Caption-it.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
  Qwen3-VL-8B-Abliterated-Caption-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen3-VL-8B-Abliterated-Caption-it.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Qwen3-VL-8B-Abliterated-Caption-it.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
62
  Qwen3-VL-8B-Abliterated-Caption-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 
64
  Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
65
  Qwen3-VL-8B-Abliterated-Caption-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
66
  Qwen3-VL-8B-Abliterated-Caption-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Qwen3-VL-8B-Abliterated-Caption-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
68
  Qwen3-VL-8B-Abliterated-Caption-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Qwen3-VL-8B-Abliterated-Caption-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
70
  Qwen3-VL-8B-Abliterated-Caption-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
71
+ Qwen3-VL-8B-Abliterated-Caption-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
72
+ Qwen3-VL-8B-Abliterated-Caption-it.f16.gguf filter=lfs diff=lfs merge=lfs -text
73
+ Qwen3-VL-8B-Abliterated-Caption-it.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
74
+ Qwen3-VL-8B-Abliterated-Caption-it.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2890a48b53a52917646a277b8c1ddb08f9bc1e2a947ed73700c1ad25ed69da7e
3
+ size 2256149952
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f72d521af15ee9f893ced013b600188f7ad21db76e73557e32e23a4f161cc1c3
3
+ size 2115771840
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0db177da431c102b140e7fe0f4d2cd5fefa54e9f2a25abf085e1f2d05cf551f
3
+ size 3051916736
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90165b39a09d6d6ef74f8fc67b111bebc6029131c1eb84e180e49f8b98dd8ba5
3
+ size 2864745920
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4f86c156289a6eaae4a7f9359495677f2d005944a8a8b2104063052a95e4048
3
+ size 2696158656
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78f91c89c210eea51e59ab20a963c9e49b1b8af46c2a6b880c77fbe55aca0949
3
+ size 2490113472
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a67ce0fcfb5528780790fd9f6343b969f8e31630c5fe2ebb9149865bd3e8e07
3
+ size 3896622528
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7373eff54d04895d61104e3a84d5afa03dcbc09a390507ab7686849456a6466e
3
+ size 3789667776
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ab6bc3c8b41ccc78a76abae529564fc607363c8c941de065ab8cb878384215f
3
+ size 3626876352
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be12cdd11c252ec581ea3fc823aa4b3be9b3091ecb7be57e033d3fb3494f941a
3
+ size 3369635264
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82ed5bbf1a8d256c75842e33b7015280d71df63ee67715bd09dc2c496ab9bed3
3
+ size 4793626048
Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:982fa873d9192f132717b776e3f0f194b8b7ecc7439eca863413e5750c06379e
3
+ size 4561841600
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77ac9c70b3ffad76c92e07bc9f54adf831a8a1103c52da6e7b9c622ee60b54cc
3
+ size 3281735104
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fafd3d73badba470332e9bc21cd5bffb3b7b91e8e2ee9ce8171616bf717ee059
3
+ size 3083554240
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1e73adb5eeee7e7bbcfaa514841ec03856c46fcfc6d70b5b16ea67b089801d5
3
+ size 4431396288
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afc2d74716c2fb46222911e51fd603c5152a85df9281c2e39138dd658ed2d4a3
3
+ size 4124163520
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83995325e1ef05e9701f5a736dfe0ea10bdf82dfc4dae47dd42703bad370a11d
3
+ size 3769613760
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1f7560fc30f25ee1f936b342fb0d770796e49b176db03a7430e5a39512aab94
3
+ size 4787334592
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5734093a67cc0b869c5064910a12e8714a5df05f77540aa48ecb4ab2047c0f54
3
+ size 5247757760
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa4b3d0094e59e38faca8ddd8393ab66bcde153758c499336ffb1799e84622ee
3
+ size 5027786176
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14f0ccb757a6a1645c75ad0eb16339487eb6a6ec4b2cd03bc2d853dc53462e93
3
+ size 4802014656
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60ae85320658d6635d0335d943a78a8844c178e0d6498b4341344d53cffd3f0d
3
+ size 5851114944
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6234544b083034447e18c8678555e478ff7bbe1d5e6812d75f6e00f66d64c26
3
+ size 5720763840
Qwen3-VL-8B-Abliterated-Caption-it.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a09161fbcec448de4e923671f850a663fcbee4950532d66fa68dacf83770f148
3
+ size 6725901760
Qwen3-VL-8B-Abliterated-Caption-it.imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6775866133fc54ecbc2862dea1bdbc3bc8f3f2b21df3cfc4e342e7c69e0d0ec7
3
+ size 5347200
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: prithivMLmods/Qwen3-VL-8B-Abliterated-Caption-it
3
+ language:
4
+ - en
5
+ - zh
6
+ - th
7
+ library_name: transformers
8
+ license: apache-2.0
9
+ mradermacher:
10
+ readme_rev: 1
11
+ quantized_by: mradermacher
12
+ tags:
13
+ - trl
14
+ - text-generation-inference
15
+ - uncensored
16
+ - image-captioning
17
+ - vlm
18
+ - visual-understanding
19
+ - caption
20
+ - image-to-text
21
+ ---
22
+ ## About
23
+
24
+ <!-- ### quantize_version: 2 -->
25
+ <!-- ### output_tensor_quantised: 1 -->
26
+ <!-- ### convert_type: hf -->
27
+ <!-- ### vocab_type: -->
28
+ <!-- ### tags: nicoboss -->
29
+ <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
30
+ <!-- ### quants_skip: -->
31
+ <!-- ### skip_mmproj: -->
32
+ weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen3-VL-8B-Abliterated-Caption-it
33
+
34
+ <!-- provided-files -->
35
+
36
+ ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF).***
37
+
38
+ static quants are available at https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-GGUF
39
+
40
+ **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-GGUF).**
41
+ ## Usage
42
+
43
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
44
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
45
+ more details, including on how to concatenate multi-part files.
46
+
47
+ ## Provided Quants
48
+
49
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
50
+
51
+ | Link | Type | Size/GB | Notes |
52
+ |:-----|:-----|--------:|:------|
53
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own qwuants) |
54
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
55
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
56
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
57
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
58
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
59
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
60
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
61
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
62
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
63
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
64
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
65
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
66
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
67
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
68
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
69
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
70
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
71
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
72
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
73
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
74
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
75
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
76
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
77
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-VL-8B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen3-VL-8B-Abliterated-Caption-it.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
78
+
79
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
80
+ types (lower is better):
81
+
82
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
83
+
84
+ And here are Artefact2's thoughts on the matter:
85
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
86
+
87
+ ## FAQ / Model Request
88
+
89
+ See https://huggingface.co/mradermacher/model_requests for some answers to
90
+ questions you might have and/or if you want some other model quantized.
91
+
92
+ ## Thanks
93
+
94
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
95
+ me use its servers and providing upgrades to my workstation to enable
96
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
97
+
98
+ <!-- end -->