Where do you all launch the model? Please help.
#10 opened 2 months ago
by
MissByron
Scored 80.00 2bit IQ2_M on MMLU Pro single shot 🔥
🚀
2
#9 opened 4 months ago
by
xbruce22
Surprised by performance (speed)
🤗
1
1
#7 opened 6 months ago
by
sousekd
Possible to do IQ2_M and IQ3_S/IQ3_M?
1
#6 opened 7 months ago
by
Panchovix
Bug: DeepSeek-V3-0324-GGUF-UD incorrectly identifies itself as GPT-4-turbo
#5 opened 7 months ago
by
emlen
Model loading error on Mac Studio (M3 Ultra) — tensor shape mismatch
#4 opened 7 months ago
by
looksgood
Math & Code Benchmark/Testing for GGUFs
3
#3 opened 7 months ago
by
bobchenyx
Thank you but some issues
👍
1
46
#2 opened 7 months ago
by
MB7977
Lots of new UD quants
2
#1 opened 7 months ago
by
segmond