noctrex
/

Moonlight-16B-A3B-Instruct-MXFP4_MOE-GGUF

Text Generation

Model card Files Files and versions

This is a MXFP4_MOE quantization of the model Moonlight-16B-A3B-Instruct

Original model: https://huggingface.co/moonshotai/Moonlight-16B-A3B-Instruct

Downloads last month: 51

GGUF

Model size

16B params

Architecture

deepseek2

Hardware compatibility

Log In to view the estimation

4-bit

Model tree for noctrex/Moonlight-16B-A3B-Instruct-MXFP4_MOE-GGUF

Base model

moonshotai/Moonlight-16B-A3B-Instruct

Quantized

(5)

this model