Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-3.1-8B-Instruct-MR-GPTQ-mxfp
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
117
Image-Text-to-Text
Transformers
Safetensors
llama
text-generation
int4
vllm
llmcompressor
conversational
text-generation-inference
8-bit precision
fp_quant
License:
llama3.1
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
Llama-3.1-8B-Instruct-MR-GPTQ-mxfp
/
tokenizer_config.json
Commit History
Initial upload of quantized model
503a075
verified
Vahe1994
commited on
Oct 2
Vahe1994
commited on
