Llama-3.1-Minitron-4B-Width-Base
ExLlamav2 8 bpw quant of https://huggingface.co/nvidia/Llama-3.1-Minitron-4B-Width-Base
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for altomek/Llama-3.1-Minitron-4B-Width-Base-8bpw-EXL2
Base model
nvidia/Llama-3.1-Minitron-4B-Width-Base