This model gives errors in cline, but new official one does not
Hello, This model gives errors in cline.
This model gives errors in cline, but new official one does not. So better try that one.
I tried the IQ4 quant, didn't work for me either, even tried to override the chat template with official model's but nada.
No idea what's going wrong :c
Just use the Mungert version with roocode works wonders, is way smarter then other versions I tried, no errors. No template leave it empty.
Use Jan.ai only as I confirm it works. Lmstudio does not work reliably for some reason.
https://huggingface.co/Mungert/KAT-Dev-GGUF
Also ask Mungert for 72B quant here: https://huggingface.co/Mungert/KAT-Dev-GGUF/discussions/1#68eaa964d682b00623299df8
update
It seems no errors are present when running:
Jan.ai v0.7.1 recent versions are unstable errors above
Mungert-kat-Dev https://huggingface.co/Mungert/KAT-Dev-GGUF
No jinja template at all.
Context set to 90k
GPU layers 100
Others settings to default
roocode v3.28.15
vscode:
Version: 1.105.1 (user setup)
Commit: 7d842fb85a0275a4a8e4d7e040d2625abbf7f084
Date: 2025-10-14T22:33:36.618Z
Electron: 37.6.0
ElectronBuildId: 12502201
Chromium: 138.0.7204.251
Node.js: 22.19.0
V8: 13.8.258.32-electron.0
OS: Windows_NT x64 10.0.26100
If you decide to test Jan.ai with other jinja templates you need to restart it and vscode close apps and start fresh, otherwise false positives happen.
No template has nice formatting, somehow it gets removed with even official template
This needs permanent fix