Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,574

Base only

Active filters: gptq

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated 19 days ago • 2.26k • 9

Reza2kn/mega-asr-onnx

Automatic Speech Recognition • Updated 8 days ago • 195 • 3

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated 5 days ago • 469 • 3

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • 33B • Updated Apr 20 • 347 • 15

groxaxo/lukey03-Qwen3.5-9B-abliterated-gptq-pro-w4g128

Text Generation • 9B • Updated Mar 23 • 99 • 2

canada-quant/DeepSeek-V4-Flash-W4A16-FP8

Text Generation • 44B • Updated 5 days ago • 8.5k • 16

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 58 • 320

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 123 • 607

TheBloke/dolphin-2.1-mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 11, 2023 • 32 • 36

openbmb/MiniCPM-2B-sft-int4

Text Generation • 3B • Updated Sep 7, 2024 • 90 • 24

openbmb/MiniCPM-2B-dpo-int4

Text Generation • 3B • Updated Sep 7, 2024 • 76 • 5

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 86.9k • 14

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Nov 18, 2024 • 710 • 22

sitatech/Qwen3-VL-8B-Instruct-GPTQ-Int4

Image-Text-to-Text • 9B • Updated Feb 6 • 243 • 1

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated Apr 24 • 42.9k • 29

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated Apr 24 • 461k • 55

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated Apr 24 • 1.05M • 85

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated Mar 10 • 131 • 8

dataslab/DLM-2.0-14B-GPTQ

Text Generation • 3B • Updated 30 days ago • 24 • 2

dataslab/DLM-2.1-14B-GPTQ

Text Generation • 3B • Updated 30 days ago • 17 • 2

groxaxo/Huihui-Qwen3.5-9B-abliterated-GPTQ-Pro-4bit-g64

Text Generation • 9B • Updated Mar 28 • 190 • 2

groxaxo/Huihui-Qwen3.5-9B-abliterated-gptq-pro-w4g128

9B • Updated Mar 29 • 10 • 1

caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ

Text Generation • 27B • Updated Apr 13 • 5 • 6

YuYu1015/Huihui-Qwen3.5-27B-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 729 • 4

YuYu1015/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 135 • 1

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 20 • 6 • 2

0xSero/Qwen3.5-264B-REAP-W4A16

Text Generation • 37B • Updated Apr 17 • 387 • 11

YuYu1015/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-int4-AutoRound

Text Generation • 7B • Updated 26 days ago • 1.22k • 1

onnx-community/PaddleOCR-VL-1.5-ONNX

Updated 24 days ago • 286 • 3

llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 22 days ago • 24.5k • 2