README.md

metadata

license: apache-2.0
base_model:
  - Vortex5/Violet-Mist-12B
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags:
  - exl3
  - 4-bit
  - 6-bit
  - 8-bit

EXL3 quants: [ H8-4.0BPW | H8-6.0BPW | H8-8.0BPW ]

Original model: Violet-Mist-12B by Vortex5