README.md

metadata

license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/blob/main/LICENSE
language:
  - en
pipeline_tag: image-text-to-text
tags:
  - multimodal
base_model:
  - Qwen/Qwen2.5-VL-72B-Instruct

Qwen2.5-VL-72B-Instruct

Converted and quantized using HimariO's fork using this procedure. No IMatrix.

Original model

Usage

./llama-qwen2vl-cli -m Qwen2.5-VL-72B-Instruct-Q4_K_M.gguf --mmproj qwen2.5-vl-72b-instruct-vision.gguf -p "Does the man in blue shirt working have a greater height compared to the wooden pallet with boxes on floor?" --image ~/warehouse_sample_3.jpeg