No link
Hello, id like to try this model, but the GGUF link goes to V1.01. I cant find V2.1 anywhere.
@Topsy1
hello, thank you for willing to try this model.
I forgot to change the name and link of GGUF version so that I think you can't find exact version of it.
I have made my own Q4_K_S quant, you could try it: https://huggingface.co/DoppelReflEx/MiniusLight-24B-v2.1-Q4_K_S-GGUF
again, thank you for using my model :)
PS: I think mradermacher will quantize this model in several hours later. I will update the link when he quantized its.
Thanks! Ill try it when i get home. You made the perfect size for my 4080 too.
You made the perfect size for my 4080 too.
mradermacher and his team is quantizing iMatrix version, you could choose better quant size that suit 4080 like Q4_K_M :)
https://huggingface.co/mradermacher/MiniusLight-24B-v2.1-GGUF
I still working with mradermacher's team and wait they quantize model for me. Will update the link when all quant version completed.
Hope I can get feedback from you. Thank you for using my model. XD
PS: All GGUF link updated, I will close this discussion now. XD