alpindale

/

GLM-4.6-INT8

like 4

hey! i ran in latest vLLM and its gives gibberish in the output (no worries just leaving feedback)

Has there been any progress?

Thanks for reporting. I think I forgot to ignore the same layers as the official FP8 quant. Will fix ASAP.