Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a8
like
18
Follow
Red Hat AI
1.64k
Text Generation
Transformers
Safetensors
8 languages
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
text-generation-inference
8-bit precision
arxiv:
2210.17323
License:
llama3.1
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
25b9a14
Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Commit History
Upload folder using huggingface_hub
25b9a14
verified
alexmarques
commited on
Jul 24, 2024
initial commit
8599c95
verified
alexmarques
commited on
Jul 24, 2024