Can you create a quantitative model for this?

#1
by xldistance - opened

Thank you so much!

xldistance changed discussion status to closed
xldistance changed discussion status to open

CC: @mradermacher 🐐

[or] I’ll do that somewhat later.

hmm, i normally quantize essentially all of your models, not sure why i skipped this one. probably i overlooked it in the ocean of Qwen* models. anyway, we'll quant it, of course.

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwen3-VL-32B-Instruct-abliterated-GGUF for quants to appear.

well, actually, if it's qwen3 vl, then it's not supported by llama.cpp,a nd that explaisn why i didn't see it: it's filtered out - see https://github.com/ggml-org/llama.cpp/issues/16207

@mradermacher
Well, that’s fine.
Thank you!

Sign up or log in to comment