Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

241

Base only

Active filters: nf4

sheikhmufrad/omniASR-LLM-7B-v2-quantized

Automatic Speech Recognition • Updated Jun 22 • 1

FINAL-Bench/POCKET-Image-Zimage

Text-to-Image • 3B • Updated Jul 28 • 136 • 42

ABDALLALSWAITI/Maxwell

Text-to-Image • 6B • Updated Sep 7, 2024 • 6

Human23/EverFlux

Text-to-Image • Updated Jul 16, 2025 • 1

sarthak247/Wan2.1-T2V-1.3B-nf4

Text-to-Video • 1B • Updated Mar 2, 2025 • 382 • 6

mengqin1/RedidreamNSFWI1-bnb-4bit

Updated May 10, 2025 • 1

Kikinoking/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated Jun 10, 2025 • 5

WaveCut/gemma-3-1b-it-qat-int4-bnb-nf4

Text Generation • 1B • Updated Jul 2, 2025 • 4

wavespeed/Wan2.1-T2V-14B-Diffusers-fp16-nf4

Text-to-Video • Updated 9 days ago • 18

jw-sohn/Llama-3.1-8B-Instruct-nf4

Text Generation • 8B • Updated Aug 17, 2025 • 5

kotlarmilos/phi-4-mini-dotnet-runtime

Text Generation • Updated Jul 9 • 1

rapidfire-ai-inc/mistral-7b-sft-bnb-4bit

Text Generation • 7B • Updated Oct 6, 2025 • 7 • 1

AlekseyCalvin/QWEN_IMAGE_nf4_w_AbliteratedTE_Diffusers

Text-to-Image • 11B • Updated Aug 6, 2025 • 64 • 15

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_transformer

15B • Updated Aug 10, 2025 • 21 • 2

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_transformer_2

15B • Updated Aug 10, 2025 • 11 • 1

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_text_encoder

6B • Updated Aug 18, 2025 • 13 • 3

lopho/Wan2.2-T2V-A14B-Diffusers_nf4

Text-to-Video • 7B • Updated Aug 18, 2025 • 35 • 1

je-suis-tm/monica_bellucci_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 24 • • 2

lopho/Wan2.2-I2V-A14B-Diffusers_nf4_transformer

15B • Updated Aug 18, 2025 • 11 • 1

lopho/Wan2.2-I2V-A14B-Diffusers_nf4_transformer_2

15B • Updated Aug 18, 2025 • 16 • 2

lopho/Wan2.2-I2V-A14B-Diffusers_nf4

Image-to-Video • 7B • Updated Aug 18, 2025 • 59 • 1

je-suis-tm/marisa_abela_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 9 • • 1

je-suis-tm/vanessa_kirby_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 33 •

je-suis-tm/melanie_laurent_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 8 •

je-suis-tm/brie_larson_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 56 •

je-suis-tm/sky_bri_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 13 •

marcusmi4n/abeja-qwen2.5-7b-japanese-quantized

Text Generation • 8B • Updated Sep 1, 2025 • 8

wavespeed/MiniCPM-V-4_5-abliterated-int4

Image-Text-to-Text • 9B • Updated 9 days ago • 51 • 3

sweatSmile/HF-SmolLM-1.7B-0.5B-4bit-coder

Text Generation • 2B • Updated Sep 10, 2025 • 11 • 1

rapidfire-ai-inc/Llama-3.2-1B-bnb-4bit

Text Generation • 1B • Updated Oct 6, 2025 • 12