New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance.
AI & ML interests
Open Source AI 💚
Recent Activity
View all activity
Qwen's new multimodal vision models in GGUF, safetensor, and dynamic Unsloth formats.
-
unsloth/Qwen3-VL-30B-A3B-Instruct-GGUF
Image-Text-to-Text • 31B • Updated • 69.5k • 37 -
unsloth/Qwen3-VL-30B-A3B-Thinking-GGUF
Image-Text-to-Text • 31B • Updated • 40.7k • 13 -
unsloth/Qwen3-VL-4B-Instruct-GGUF
Image-Text-to-Text • 4B • Updated • 37.6k • 20 -
unsloth/Qwen3-VL-4B-Thinking-GGUF
Image-Text-to-Text • 4B • Updated • 19.5k • 10
DeepSeek's new 3.1 update to their V3 models!
The Qwen3-Coder models deliver SOTA advancements in agentic coding and code tasks. Includes Qwen3-Coder-480B-A35B.
-
unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
Text Generation • 31B • Updated • 170k • 323 -
unsloth/Qwen3-Coder-30B-A3B-Instruct-1M-GGUF
Text Generation • 31B • Updated • 23.3k • 121 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 11.6k • 161 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-1M-GGUF
Text Generation • 480B • Updated • 1.15k • 40
IBM's new Granite-4.0 models! Run Dynamic GGUFs or fine-tune with Unsloth.
Meta's new Llama 4 multimodal models, Scout & Maverick. Includes Dynamic GGUFs, 16-bit & Dynamic 4-bit uploads. Run & fine-tune them with Unsloth!
-
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
Image-Text-to-Text • 108B • Updated • 30.2k • 125 -
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF
Image-Text-to-Text • 401B • Updated • 8.6k • 38 -
unsloth/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 1.08k • 54 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • 57B • Updated • 895 • 80
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 47.4k • 36 -
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • 10B • Updated • 1.82k • 29 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 2.35k • 24 -
unsloth/gemma-3-12b-it-unsloth-bnb-4bit
Image-Text-to-Text • 12B • Updated • 26.5k • 23
A collection of 4-bit, Dynamic 4-bit and 16-bit voice models including Sesame-CSM, OpenAI's Whisper, Orpheus. Fine-tune them with Unsloth now!
-
unsloth/orpheus-3b-0.1-ft-GGUF
Text-to-Speech • 3B • Updated • 1.34k • 8 -
unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit
Text-to-Speech • 2B • Updated • 7.54k • 14 -
unsloth/csm-1b
Text-to-Speech • 2B • Updated • 12.9k • 18 -
unsloth/whisper-large-v3
Automatic Speech Recognition • 2B • Updated • 9.05k • 13
A collection of Mistral's new Small 3.2 and 3 models including GGUF, 4-bit and more!
-
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Image-Text-to-Text • 24B • Updated • 34.4k • 131 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506
Image-Text-to-Text • 24B • Updated • 2.93k • • 11 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8
Image-Text-to-Text • Updated • 102 • 6 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit
Image-Text-to-Text • 13B • Updated • 6.21k • 11
Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions.
Qwen's reasoning models including QwQ (32B) & QVQ (72B) in formats: GGUF, dynamic 4-bit and 16-bit original versions.
-
unsloth/QwQ-32B-GGUF
Text Generation • 33B • Updated • 2.93k • 86 -
unsloth/QwQ-32B-unsloth-bnb-4bit
Text Generation • 19B • Updated • 503 • 47 -
unsloth/QwQ-32B
Text Generation • 33B • Updated • 46 • • 17 -
unsloth/QwQ-32B-bnb-4bit
Text Generation • 18B • Updated • 399 • 4
Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions.
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 33.4k • 85 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Llama-3.2-11B-Vision
Image-to-Text • 11B • Updated • 178 • 34 -
unsloth/Llama-3.2-11B-Vision-bnb-4bit
Image-to-Text • 6B • Updated • 150 • 16
Meta's Llama 3.1 models including 8B, 70B, 405B. Includes 4-bit bnb and original versions.
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 287k • 87 -
unsloth/Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 53.9k • 4 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 195k • 4 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 22.1k • 104
Native bitsandbytes 4bit pre quantized models
-
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation • 2B • Updated • 9k • 20 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 22.1k • 104 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • 5B • Updated • 74.6k • 133 -
unsloth/gemma-2-9b-bnb-4bit
Text Generation • 5B • Updated • 7.88k • 31
OpenAI's gpt-oss-20b and gpt-oss-120b is here! The powerful open models are available in GGUF, original & 4-bit formats.
-
unsloth/gpt-oss-20b-GGUF
Text Generation • 21B • Updated • 226k • 473 -
unsloth/gpt-oss-120b-GGUF
Text Generation • 117B • Updated • 147k • 170 -
unsloth/gpt-oss-20b-unsloth-bnb-4bit
Text Generation • 21B • Updated • 201k • 35 -
unsloth/gpt-oss-120b-unsloth-bnb-4bit
Text Generation • 117B • Updated • 13.3k • 9
Qwen's new Qwen3 models. In Unsloth Dynamic 2.0, GGUF, 4-bit and 16-bit Safetensor formats. Includes 128K Context Length variants.
-
unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF
31B • Updated • 36.9k • 262 -
unsloth/Qwen3-4B-Instruct-2507-GGUF
4B • Updated • 52.1k • 93 -
unsloth/Qwen3-4B-Thinking-2507-GGUF
4B • Updated • 14.1k • 68 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 11.6k • 161
DeepSeek-R1-0528 is here! The most powerful reasoning open LLM, available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models.
-
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation • 8B • Updated • 77k • 339 -
unsloth/DeepSeek-R1-0528-GGUF
Text Generation • 671B • Updated • 4.7k • 193 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 8.95k • 13 -
unsloth/DeepSeek-R1-0528
Text Generation • 685B • Updated • 36 • 15
All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats.
-
unsloth/gemma-3-270m-it-GGUF
Text Generation • 0.3B • Updated • 25.3k • 129 -
unsloth/gemma-3-270m-it-qat-GGUF
Text Generation • 0.3B • Updated • 6.53k • 11 -
unsloth/gemma-3-270m-it
Text Generation • 0.3B • Updated • 46k • 20 -
unsloth/gemma-3-270m-it-unsloth-bnb-4bit
Text Generation • 0.2B • Updated • 23.3k • 4
Google Gemma 3n models, all versions including Dynamic GGUF, 4-bit, 16-bit and formats!
-
unsloth/gemma-3n-E4B-it-GGUF
Image-Text-to-Text • 7B • Updated • 37.9k • 173 -
unsloth/gemma-3n-E2B-it-GGUF
Image-Text-to-Text • 4B • Updated • 19.3k • 50 -
unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 23.8k • 9 -
unsloth/gemma-3n-E4B-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 2.54k • 4
Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes
-
unsloth/Phi-4-reasoning-plus-GGUF
Text Generation • 15B • Updated • 6.9k • 74 -
unsloth/Phi-4-mini-reasoning-GGUF
Text Generation • 4B • Updated • 5.97k • 52 -
unsloth/Phi-4-reasoning-GGUF
Text Generation • 15B • Updated • 2.2k • 18 -
unsloth/phi-4-GGUF
Text Generation • 15B • Updated • 3.01k • 180
Deepseek-V3-0324 and V3 - available in original, and Dynamic GGUF formats, with support for 2-8-bit quantized versions.
-
unsloth/DeepSeek-V3-0324-GGUF-UD
Text Generation • 671B • Updated • 1.33k • 20 -
unsloth/DeepSeek-V3-0324-GGUF
Text Generation • 671B • Updated • 3.23k • 193 -
unsloth/DeepSeek-V3-0324
Text Generation • 684B • Updated • 25 • 7 -
unsloth/DeepSeek-V3-0324-BF16
Text Generation • 684B • Updated • 7.8k • 4
Find GGUFs and other variants of diffusion based and Black Forest Lab's FLUX models.
Meta's new Llama 3.2 vision and text models including 1B, 3B, 11B and 90B. Includes GGUF, 4-bit bnb and original versions.
-
unsloth/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 26.3k • 44 -
unsloth/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 327k • 80 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • 0.8B • Updated • 40.9k • 5 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 16k • 20
All versions of Qwen2.5-VL including the new 32B version and 4-bit, 16-bit and more!
-
unsloth/Qwen2.5-VL-3B-Instruct-GGUF
Image-Text-to-Text • 3B • Updated • 8.7k • 17 -
unsloth/Qwen2.5-VL-7B-Instruct-GGUF
Image-Text-to-Text • 8B • Updated • 85.4k • 100 -
unsloth/Qwen2.5-VL-32B-Instruct-GGUF
Image-Text-to-Text • 33B • Updated • 2.3k • 6 -
unsloth/Qwen2.5-VL-72B-Instruct-GGUF
Image-Text-to-Text • 73B • Updated • 1.54k • 7
Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more!
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 33.4k • 85 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-to-Text • 6B • Updated • 6.93k • 28 -
unsloth/Qwen2-VL-7B-Instruct-bnb-4bit
Image-Text-to-Text • 5B • Updated • 2.16k • 6
Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats.
-
unsloth/Qwen2.5-Coder-32B-Instruct-128K-GGUF
33B • Updated • 860 • 71 -
unsloth/Qwen2.5-Coder-14B-Instruct-128K-GGUF
15B • Updated • 1.31k • 30 -
unsloth/Qwen2.5-Coder-7B-Instruct-128K-GGUF
8B • Updated • 5.32k • 19 -
unsloth/Qwen2.5-Coder-3B-Instruct-128K-GGUF
3B • Updated • 649 • 13
-
unsloth/Qwen2.5-7B-Instruct-bnb-4bit
Text Generation • 4B • Updated • 34.4k • 17 -
unsloth/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 82.1k • • 18 -
unsloth/Qwen2.5-14B-bnb-4bit
Text Generation • 8B • Updated • 61 • 5 -
unsloth/Qwen2.5-7B-bnb-4bit
Text Generation • 4B • Updated • 2.64k • 6
-
unsloth/Llama-3.2-3B-Instruct-bnb-4bit
Text Generation • 2B • Updated • 20.6k • 30 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 16k • 20 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 287k • 87
New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance.
OpenAI's gpt-oss-20b and gpt-oss-120b is here! The powerful open models are available in GGUF, original & 4-bit formats.
-
unsloth/gpt-oss-20b-GGUF
Text Generation • 21B • Updated • 226k • 473 -
unsloth/gpt-oss-120b-GGUF
Text Generation • 117B • Updated • 147k • 170 -
unsloth/gpt-oss-20b-unsloth-bnb-4bit
Text Generation • 21B • Updated • 201k • 35 -
unsloth/gpt-oss-120b-unsloth-bnb-4bit
Text Generation • 117B • Updated • 13.3k • 9
Qwen's new multimodal vision models in GGUF, safetensor, and dynamic Unsloth formats.
-
unsloth/Qwen3-VL-30B-A3B-Instruct-GGUF
Image-Text-to-Text • 31B • Updated • 69.5k • 37 -
unsloth/Qwen3-VL-30B-A3B-Thinking-GGUF
Image-Text-to-Text • 31B • Updated • 40.7k • 13 -
unsloth/Qwen3-VL-4B-Instruct-GGUF
Image-Text-to-Text • 4B • Updated • 37.6k • 20 -
unsloth/Qwen3-VL-4B-Thinking-GGUF
Image-Text-to-Text • 4B • Updated • 19.5k • 10
Qwen's new Qwen3 models. In Unsloth Dynamic 2.0, GGUF, 4-bit and 16-bit Safetensor formats. Includes 128K Context Length variants.
-
unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF
31B • Updated • 36.9k • 262 -
unsloth/Qwen3-4B-Instruct-2507-GGUF
4B • Updated • 52.1k • 93 -
unsloth/Qwen3-4B-Thinking-2507-GGUF
4B • Updated • 14.1k • 68 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 11.6k • 161
DeepSeek's new 3.1 update to their V3 models!
DeepSeek-R1-0528 is here! The most powerful reasoning open LLM, available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models.
-
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation • 8B • Updated • 77k • 339 -
unsloth/DeepSeek-R1-0528-GGUF
Text Generation • 671B • Updated • 4.7k • 193 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 8.95k • 13 -
unsloth/DeepSeek-R1-0528
Text Generation • 685B • Updated • 36 • 15
The Qwen3-Coder models deliver SOTA advancements in agentic coding and code tasks. Includes Qwen3-Coder-480B-A35B.
-
unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
Text Generation • 31B • Updated • 170k • 323 -
unsloth/Qwen3-Coder-30B-A3B-Instruct-1M-GGUF
Text Generation • 31B • Updated • 23.3k • 121 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 11.6k • 161 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-1M-GGUF
Text Generation • 480B • Updated • 1.15k • 40
All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats.
-
unsloth/gemma-3-270m-it-GGUF
Text Generation • 0.3B • Updated • 25.3k • 129 -
unsloth/gemma-3-270m-it-qat-GGUF
Text Generation • 0.3B • Updated • 6.53k • 11 -
unsloth/gemma-3-270m-it
Text Generation • 0.3B • Updated • 46k • 20 -
unsloth/gemma-3-270m-it-unsloth-bnb-4bit
Text Generation • 0.2B • Updated • 23.3k • 4
IBM's new Granite-4.0 models! Run Dynamic GGUFs or fine-tune with Unsloth.
Google Gemma 3n models, all versions including Dynamic GGUF, 4-bit, 16-bit and formats!
-
unsloth/gemma-3n-E4B-it-GGUF
Image-Text-to-Text • 7B • Updated • 37.9k • 173 -
unsloth/gemma-3n-E2B-it-GGUF
Image-Text-to-Text • 4B • Updated • 19.3k • 50 -
unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 23.8k • 9 -
unsloth/gemma-3n-E4B-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 2.54k • 4
Meta's new Llama 4 multimodal models, Scout & Maverick. Includes Dynamic GGUFs, 16-bit & Dynamic 4-bit uploads. Run & fine-tune them with Unsloth!
-
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
Image-Text-to-Text • 108B • Updated • 30.2k • 125 -
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF
Image-Text-to-Text • 401B • Updated • 8.6k • 38 -
unsloth/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 1.08k • 54 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • 57B • Updated • 895 • 80
Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes
-
unsloth/Phi-4-reasoning-plus-GGUF
Text Generation • 15B • Updated • 6.9k • 74 -
unsloth/Phi-4-mini-reasoning-GGUF
Text Generation • 4B • Updated • 5.97k • 52 -
unsloth/Phi-4-reasoning-GGUF
Text Generation • 15B • Updated • 2.2k • 18 -
unsloth/phi-4-GGUF
Text Generation • 15B • Updated • 3.01k • 180
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 47.4k • 36 -
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • 10B • Updated • 1.82k • 29 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 2.35k • 24 -
unsloth/gemma-3-12b-it-unsloth-bnb-4bit
Image-Text-to-Text • 12B • Updated • 26.5k • 23
Deepseek-V3-0324 and V3 - available in original, and Dynamic GGUF formats, with support for 2-8-bit quantized versions.
-
unsloth/DeepSeek-V3-0324-GGUF-UD
Text Generation • 671B • Updated • 1.33k • 20 -
unsloth/DeepSeek-V3-0324-GGUF
Text Generation • 671B • Updated • 3.23k • 193 -
unsloth/DeepSeek-V3-0324
Text Generation • 684B • Updated • 25 • 7 -
unsloth/DeepSeek-V3-0324-BF16
Text Generation • 684B • Updated • 7.8k • 4
A collection of 4-bit, Dynamic 4-bit and 16-bit voice models including Sesame-CSM, OpenAI's Whisper, Orpheus. Fine-tune them with Unsloth now!
-
unsloth/orpheus-3b-0.1-ft-GGUF
Text-to-Speech • 3B • Updated • 1.34k • 8 -
unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit
Text-to-Speech • 2B • Updated • 7.54k • 14 -
unsloth/csm-1b
Text-to-Speech • 2B • Updated • 12.9k • 18 -
unsloth/whisper-large-v3
Automatic Speech Recognition • 2B • Updated • 9.05k • 13
Find GGUFs and other variants of diffusion based and Black Forest Lab's FLUX models.
A collection of Mistral's new Small 3.2 and 3 models including GGUF, 4-bit and more!
-
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Image-Text-to-Text • 24B • Updated • 34.4k • 131 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506
Image-Text-to-Text • 24B • Updated • 2.93k • • 11 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8
Image-Text-to-Text • Updated • 102 • 6 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit
Image-Text-to-Text • 13B • Updated • 6.21k • 11
Meta's new Llama 3.2 vision and text models including 1B, 3B, 11B and 90B. Includes GGUF, 4-bit bnb and original versions.
-
unsloth/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 26.3k • 44 -
unsloth/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 327k • 80 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • 0.8B • Updated • 40.9k • 5 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 16k • 20
Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions.
All versions of Qwen2.5-VL including the new 32B version and 4-bit, 16-bit and more!
-
unsloth/Qwen2.5-VL-3B-Instruct-GGUF
Image-Text-to-Text • 3B • Updated • 8.7k • 17 -
unsloth/Qwen2.5-VL-7B-Instruct-GGUF
Image-Text-to-Text • 8B • Updated • 85.4k • 100 -
unsloth/Qwen2.5-VL-32B-Instruct-GGUF
Image-Text-to-Text • 33B • Updated • 2.3k • 6 -
unsloth/Qwen2.5-VL-72B-Instruct-GGUF
Image-Text-to-Text • 73B • Updated • 1.54k • 7
Qwen's reasoning models including QwQ (32B) & QVQ (72B) in formats: GGUF, dynamic 4-bit and 16-bit original versions.
-
unsloth/QwQ-32B-GGUF
Text Generation • 33B • Updated • 2.93k • 86 -
unsloth/QwQ-32B-unsloth-bnb-4bit
Text Generation • 19B • Updated • 503 • 47 -
unsloth/QwQ-32B
Text Generation • 33B • Updated • 46 • • 17 -
unsloth/QwQ-32B-bnb-4bit
Text Generation • 18B • Updated • 399 • 4
Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more!
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 33.4k • 85 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-to-Text • 6B • Updated • 6.93k • 28 -
unsloth/Qwen2-VL-7B-Instruct-bnb-4bit
Image-Text-to-Text • 5B • Updated • 2.16k • 6
Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions.
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 33.4k • 85 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Llama-3.2-11B-Vision
Image-to-Text • 11B • Updated • 178 • 34 -
unsloth/Llama-3.2-11B-Vision-bnb-4bit
Image-to-Text • 6B • Updated • 150 • 16
Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats.
-
unsloth/Qwen2.5-Coder-32B-Instruct-128K-GGUF
33B • Updated • 860 • 71 -
unsloth/Qwen2.5-Coder-14B-Instruct-128K-GGUF
15B • Updated • 1.31k • 30 -
unsloth/Qwen2.5-Coder-7B-Instruct-128K-GGUF
8B • Updated • 5.32k • 19 -
unsloth/Qwen2.5-Coder-3B-Instruct-128K-GGUF
3B • Updated • 649 • 13
Meta's Llama 3.1 models including 8B, 70B, 405B. Includes 4-bit bnb and original versions.
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 287k • 87 -
unsloth/Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 53.9k • 4 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 195k • 4 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 22.1k • 104
-
unsloth/Qwen2.5-7B-Instruct-bnb-4bit
Text Generation • 4B • Updated • 34.4k • 17 -
unsloth/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 82.1k • • 18 -
unsloth/Qwen2.5-14B-bnb-4bit
Text Generation • 8B • Updated • 61 • 5 -
unsloth/Qwen2.5-7B-bnb-4bit
Text Generation • 4B • Updated • 2.64k • 6
Native bitsandbytes 4bit pre quantized models
-
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation • 2B • Updated • 9k • 20 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 22.1k • 104 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • 5B • Updated • 74.6k • 133 -
unsloth/gemma-2-9b-bnb-4bit
Text Generation • 5B • Updated • 7.88k • 31
-
unsloth/Llama-3.2-3B-Instruct-bnb-4bit
Text Generation • 2B • Updated • 20.6k • 30 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 16k • 20 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 8.21k • 79 -
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 287k • 87