V0.1 at 4.0-4.25bpw?
#1
by
Surprisekitty
- opened
Howdy! I love your work. I was wondering if EVA-LLaMA-3.33-70B-v0.1 was on the table? The only EXL2 quant around for that model is 5.0bpw, and I would be really grateful if a 4.0-4.25bpw was made. If not, no worries - just wanted to put the suggestion out there.
Dracones
changed discussion status to
closed