Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-precision

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

498

Base only

Active filters: mixed-precision

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 1 day ago • 13.2k • 64

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 1 day ago • 12.2k • 77

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 1 day ago • 13.4k • 14

avlp12/GLM-5.2-Alis-MLX-Dynamic-3.5bpw

Text Generation • 753B • Updated 2 days ago • 9.2k • 5

rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm

20B • Updated 17 days ago • 13.5k • 16

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated 7 days ago • 3.15k • 6

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 1 day ago • 14.8k • 44

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated 1 day ago • 2.03k • 6

avlp12/GLM-5.2-Alis-MLX-Dynamic-2.56bpw

Text Generation • 743B • Updated 2 days ago • 5.53k • 2

sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-optiq-5bpw-mlx

9B • Updated 17 days ago • 4.26k • 6

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 1 day ago • 2.22k • 21

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 1 day ago • 7.49k • 24

dealignai/Qwen3.5-VL-4B-JANG_4S-CRACK

Image-Text-to-Text • 1B • Updated Apr 17 • 482 • 9

TheCluster/Qwen3.5-122B-A10B-Heretic-v2-MLX-mixed-6bit

Image-Text-to-Text • 122B • Updated Apr 11 • 252 • 2

varjosoft/Qwen3.6-35B-A3B-TQ-apex3

Text Generation • 16B • Updated Apr 20 • 351 • 4

dealignai/Qwen3.6-27B-JANG_4M-CRACK

Image-Text-to-Text • 5B • Updated Apr 23 • 1.7k • 24

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 1 day ago • 15k • 9

rdtand/MiniMax-M2.7-PrismaQuant-3.20bit-vllm

Text Generation • 94B • Updated Apr 28 • 1.33k • 11

rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

17B • Updated May 4 • 270k • 35

JANGQ-AI/Hy3-preview-JANGTQ_K

Text Generation • 28B • Updated May 11 • 321 • 2

mlx-community/NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 22 days ago • 1.64k • 3

IvanSmit05/gemma-4-12B-it-heretic-mlx-4bit

Any-to-Any • 3B • Updated Jun 4 • 369 • 2

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 1 day ago • 19.8k • 39

sahilchachra/lfm2.5-1.2b-jp-optiq-5bpw-mlx

0.2B • Updated Jun 6 • 84 • 2

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 1 day ago • 7.46k • 6

mlx-community/Nex-N2-mini-mlx-optiq-static-mixed-3_6bits

35B • Updated 23 days ago • 354 • 2

WaveCut/Qwen3.6-35B-A3B-REAM-160-ru-agent-GGUF

23B • Updated 21 days ago • 2.84k • 5

mlx-community/VibeThinker-3B-OptiQ-4bit

Text Generation • 0.6B • Updated 17 days ago • 370 • 2

sahilchachra/ornith-1.0-9b-optiq-5bpw-mlx

9B • Updated 15 days ago • 1.64k • 3

aisamdasu/Algocean-Qwen3.6-35B-A3B-mlx-OptiQ

Text Generation • 35B • Updated 4 days ago • 189 • 1