noctrex
/

SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

Text Generation

Model card Files Files and versions

This is a MXFP4_MOE quantization of the model SmallThinker-4BA0.6B-Instruct
A quantization with imatrix is also included

Original model: https://huggingface.co/PowerInfer/SmallThinker-4BA0.6B-Instruct

Downloads last month: 74

GGUF

Model size

4B params

Architecture

smallthinker

Hardware compatibility

Log In to view the estimation

4-bit

View +1 variant

Model tree for noctrex/SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

Base model

PowerInfer/SmallThinker-4BA0.6B-Instruct

Quantized

(8)

this model