Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: qat

sdkyuan/qwen3.8-27B-qat-q2_0-gguf

Text Generation • 27B • Updated 10 days ago • 9.35k • 25

KeinNiemand/DeepSeek-V4-Flash-0731-IK_GGUF

Text Generation • 284B • Updated 4 days ago • 1.89k • 5

SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF

25B • Updated Jun 11 • 14.6k • 26

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated Jul 6 • 8.12k • 47

FreedomAISVR/Gemma-4-26B-A4B-it-QAT-MXFP4-GGUF

25B • Updated Jun 19 • 368 • 2

sakamakismile/Huihui-gemma-4-31B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 18B • Updated Jun 12 • 468 • 2

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated Jul 20 • 3.12k • 15

AutomatosX/AX-Gemma-4-12B-IT-MLX-QAT-OptiQ-4bit-Assistant-MTP

Image-Text-to-Text • 12B • Updated Jul 23 • 700 • 3

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 28 days ago • 19.8k • 31

ProCreations/Booper-Big-Chat

Text Generation • 0.2B • Updated 6 days ago • 309 • 1

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 6

Thomaschtl/test3

Text Generation • 0.2B • Updated Jun 4, 2025 • 8

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated Dec 12, 2025 • 29 • • 2

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 216

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 706

thebajajra/RexReranker-0.6B-MXFP4

Text Ranking • 0.5B • Updated Jan 24 • 9 • 3

Adanmohh/apuri-v3-0.6b-sft-qat-gguf

0.6B • Updated Jan 14 • 9

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 8

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 6

Harahan/QVGen-Wan-1_3B-W4A4

Text-to-Video • 1B • Updated Feb 2 • 11 • 2

Harahan/QVGen-CogVideoX-2B-W4A4

Text-to-Video • 2B • Updated Feb 2 • 959 • 2

Sikaworld1990/gemma-3-12b-qat-abliterated-sikaworld-fp4-ltx2

Feature Extraction • Updated Mar 11 • 39

kusakana/ReasoningQAT-Qwen3-1.7B-3bit

2B • Updated Mar 20 • 12

kusakana/ReasoningQAT-Qwen3-1.7B-2bit

2B • Updated Mar 20 • 8

kusakana/ReasoningQAT-Qwen3-4B-3bit

4B • Updated Mar 20 • 8

kusakana/ReasoningQAT-Qwen3-4B-2bit

4B • Updated Mar 20 • 22

kusakana/ReasoningQAT-Qwen3-8B-3bit

8B • Updated Mar 20 • 8

kusakana/ReasoningQAT-Qwen3-8B-2bit

8B • Updated Mar 20 • 10