Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Qwen2.5-VL-3B-Instruct-quantized.w8a8
like
2
Follow
Red Hat AI
1.73k
Image-to-Text
Transformers
Safetensors
English
qwen2_5_vl
vllm
vision
w8a8
text-generation-inference
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Qwen2.5-VL-3B-Instruct-quantized.w8a8
5.37 GB
3 contributors
History:
14 commits
shubhrapandit
Update files to match base model keeping quant_config intact
fcd4bf9
8 months ago
.gitattributes
1.57 kB
Upload model files
10 months ago
README.md
15.2 kB
Update README.md
9 months ago
chat_template.json
1.05 kB
Update files to match base model keeping quant_config intact
8 months ago
config.json
8.5 kB
Update files to match base model keeping quant_config intact
8 months ago
generation_config.json
216 Bytes
Update files to match base model keeping quant_config intact
8 months ago
merges.txt
1.67 MB
Update files to match base model keeping quant_config intact
8 months ago
model-00001-of-00002.safetensors
4.74 GB
xet
Upload model files
10 months ago
model-00002-of-00002.safetensors
622 MB
xet
Upload model files
10 months ago
model.safetensors.index.json
87.5 kB
Upload model files
10 months ago
preprocessor_config.json
350 Bytes
Update files to match base model keeping quant_config intact
8 months ago
recipe.yaml
185 Bytes
Upload model files
10 months ago
tokenizer.json
7.03 MB
xet
Update files to match base model keeping quant_config intact
8 months ago
tokenizer_config.json
5.7 kB
Update files to match base model keeping quant_config intact
8 months ago
vocab.json
2.78 MB
Upload model files
10 months ago
