Data-free quantization w/ Q-Palette
Collection
30 items
•
Updated
Model Card
- Base model:
meta-llama/Llama-3.2-1B - Quantization method: TCQ in Q-Palette
- Target bit-width: 4
- Backend kernel: Q-Palette kernel
- Calibration data: N/A (data-free)
How to run
- Follow the instruction in https://github.com/snu-mllab/Q-Palette.
References
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for bdbj/Llama-3.2-1B-qpal-df-tcq-4bit
Base model
meta-llama/Llama-3.2-1B