Can you create a quantitative model for this?
#1
by
xldistance
- opened
Thank you so much!
xldistance
changed discussion status to
closed
xldistance
changed discussion status to
open
hmm, i normally quantize essentially all of your models, not sure why i skipped this one. probably i overlooked it in the ocean of Qwen* models. anyway, we'll quant it, of course.
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwen3-VL-32B-Instruct-abliterated-GGUF for quants to appear.
well, actually, if it's qwen3 vl, then it's not supported by llama.cpp,a nd that explaisn why i didn't see it: it's filtered out - see https://github.com/ggml-org/llama.cpp/issues/16207