Aleph-Alpha-Research/1BW-Llama-4B-16Bit-SFT

LLaMA 3.7B - Bfloat16

📚 Paper • 🏠 GitHub

This is one of the checkpoints supplementing the paper 1-Bit-Wonder: Improving QAT Performance in the Low-Bit Regime through K-Means Quantization. Instructions on how to use the model for inference can be found in the corresponding repository.

⚠️ IMPORTANT: This model is intended for research purposes only. It is provided as-is without warranties for production use.

Model Details

• Architecture: LLaMA
• Size: 3.7B (3,747,523,584 parameters)

Directory Structure

.
├── config.json                  # HuggingFace model config
├── generation_config.json       # Default generation settings
├── tokenizer.json              # Tokenizer files
└── model.safetensors           # Weights (in Bfloat16)

License

See LICENSE file in the repository.

Citation

If you find this work helpful, please cite:

@inproceedings{
maskey2026bit,
title={1-Bit Wonder: Improving {QAT} Performance in the Low-Bit Regime through K-Means Quantization},
author={Sohir Maskey and Constantin Eichenberg and Johannes Messner and Douglas Orr},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=6EGpWhH2yx}
}