Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
RedHatAI 's Collections
Red Hat AI validated models - October 2025
Red Hat AI validated models - September 2025
Speculator Models
Red Hat AI validated models - May 2025
Gemma-3 Quantized
Whisper Quantized
Llama 4 Quantized
Qwen3 Quantized
Mistral-Small-3.1 (2503) Instruct Quantized
Phi-4 Quantized
Llama 3.3 70B Instruct Quantized
Qwen 2.5 Quantized
Granite Quantized
vLLM Kernels

Llama 3.3 70B Instruct Quantized

updated Jul 29

Quantized variants of Meta Llama 3.3 multilingual large language model (LLM) is an instruction tuned generative model in 70B (text in/text out).

Upvote
1

  • RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

    Text Generation • 71B • Updated Sep 22 • 21.4k • 12

  • RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

    Text Generation • Updated Sep 22 • 2.14M • 11

  • RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

    Text Generation • 11B • Updated Sep 22 • 600 • 3
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs