nvidia/DeepSeek-R1-0528-FP4
Text Generation
•
Updated
•
101k
•
37
Inference Optimized Checkpoints (with Model Optimizer)
A collection of generative models quantized and optimized for inference with TensorRT Model Optimizer.
-
-
nvidia/DeepSeek-R1-0528-FP4-v2
Text Generation • 394B • Updated • 55.8k • 8 -
nvidia/Llama-3.3-70B-Instruct-FP4
41B • Updated • 25.8k • 23 -
nvidia/Llama-3.3-70B-Instruct-FP8
71B • Updated • 48.9k • 9 -
nvidia/Llama-3.1-8B-Instruct-FP4
5B • Updated • 16k • 1 -
nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 31.3k • • 30 -
nvidia/Qwen3-235B-A22B-FP4
Text Generation • Updated • 2.89k • 1 -
nvidia/Qwen3-235B-A22B-FP8
Text Generation • Updated • 633 -
nvidia/Qwen3-30B-A3B-FP4
Text Generation • 16B • Updated • 3.07k • 9 -
nvidia/Qwen3-32B-FP4
Text Generation • 17B • Updated • 10.5k • 1 -
nvidia/Qwen3-14B-FP4
Text Generation • 8B • Updated • 3.32k • 2 -
nvidia/Qwen3-14B-FP8
Text Generation • 15B • Updated • 1.96k -
nvidia/Qwen3-8B-FP4
Text Generation • 5B • Updated • 3.84k • 3 -
nvidia/Qwen3-8B-FP8
Text Generation • 8B • Updated • 3.26k -
nvidia/Llama-3_3-Nemotron-Super-49B-v1_5-FP8
Text Generation • 50B • Updated • 12.5k • 20 -
nvidia/Llama-3_1-Nemotron-Ultra-253B-v1-FP8
Text Generation • 253B • Updated • 187 • 8 -
nvidia/Llama-4-Scout-17B-16E-Instruct-FP4
56B • Updated • 20.2k • 4 -
nvidia/Llama-4-Scout-17B-16E-Instruct-FP8
109B • Updated • 241k • 6 -
nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8
402B • Updated • 1.69k • 9 -
nvidia/Phi-4-reasoning-plus-FP8
15B • Updated • 100k • 1 -
nvidia/Qwen2.5-VL-7B-Instruct-FP4
Text Generation • 5B • Updated • 2.18k • 3 -
black-forest-labs/FLUX.1-dev-onnx
Text-to-Image • Updated • 98 -
nvidia/DeepSeek-R1-FP4
Text Generation • Updated • 6.69k • 264 -
nvidia/DeepSeek-R1-FP4-v2
Text Generation • 394B • Updated • 311 • 3 -
nvidia/DeepSeek-V3-0324-FP4
Text Generation • Updated • 18.9k • 12 -
nvidia/Llama-3_3-Nemotron-Super-49B-v1-FP8
Text Generation • 50B • Updated • 341 • 9 -
nvidia/Llama-3.1-70B-Instruct-FP8
Text Generation • 71B • Updated • 8.92k • • 13 -
nvidia/Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 3.53k • 11 -
nvidia/Llama-3.1-405B-Instruct-FP4
230B • Updated • 2.12k • 5 -
nvidia/Phi-4-multimodal-instruct-FP4
4B • Updated • 673 • 4 -
nvidia/Phi-4-multimodal-instruct-FP8
6B • Updated • 384 • 1 -
nvidia/Phi-4-reasoning-plus-FP4
8B • Updated • 384 • 4 -
nvidia/Qwen2.5-VL-7B-Instruct-FP8
Text Generation • 8B • Updated • 600 • 3