---
library_name: exllamav3
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507/blob/main/LICENSE
pipeline_tag: text-generation
base_model: Qwen/Qwen3-235B-A22B-Thinking-2507
base_model_relation: quantized
tags:
  - exl3
---


Exl3 5.0bpw h6 quantization of [Qwen/Qwen3-235B-A22B-Thinking-2507](https://huggingface.co/Qwen/Qwen3-235B-A22B-Thinking-2507) using `69750c8` commit of [Exllamav3](https://github.com/turboderp-org/exllamav3)

148.4gb, requires ~160gb with 64k unquantized context.