cyankiwi/aquif-3.5-Max-42B-A3B-AWQ-4bit · Update thinking=true by default

Update thinking=true by default

by pramjana - opened 7 days ago

←

7 days ago

Hi @cyankiwi,

Thanks for making this quant!

Thinking = True by default makes this model much stronger, based on the author's references to the benchmarks. Could we do this change?

Best,
Pramod

cyankiwi org 5 days ago

Hi Pramod,

Thank you for the PR request.

But isn't the chat template by default has thinking = false? And isn't aquif-3.5-Max-42B-A3B a reasoning-only model?

Thanks,

Ton

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment