Support this work → · X · GitHub · REAP paper · Cerebras REAP

GLM-5.3-569B — REAP keep-192 (EXL3 TR3 3.42bpw)

GLM-5.3 with 25% of its experts removed — 277 GB, sized to serve in ~300 GB of VRAM. A REAP prune applied directly to davidsyoung/GLM-5.3-EXL3-TR3-3.42bpw, the standard-compliant EXL3 quant (routed experts quantized, sensitive layers BF16).

What this is

GLM-5.3 is a 753B mixture-of-experts model (8 of 256 experts per token, ~40B active). This checkpoint keeps 192 of 256 routed experts per layer, chosen by the max-over-domain saliency criterion (each expert scored by its largest share of any single domain's routed work, so every domain keeps its specialists). Whole experts are dropped, the survivors renumbered, and the routers + MTP layer sliced to match — applied byte-exact to the already-quantized checkpoint, so nothing is re-quantized.


Base	davidsyoung/GLM-5.3-EXL3-TR3-3.42bpw (EXL3 trellis, experts-only quant, BF16 sensitive)
Prune	REAP keep-192/256 (25% removed), max-over-domain saliency, all MoE layers + MTP
Size	277 GB (fits ~300 GB VRAM)
KL vs BF16	measured on GPU — see the fidelity study