This is a MXFP4_MOE quantization of the model Mixtral-8x7B-Instruct-v0.1
Original model: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
- Downloads last month
- 153
Hardware compatibility
Log In
to view the estimation
4-bit
Model tree for noctrex/Mixtral-8x7B-Instruct-v0.1-MXFP4_MOE-GGUF
Base model
mistralai/Mixtral-8x7B-v0.1
Finetuned
mistralai/Mixtral-8x7B-Instruct-v0.1