noctrex
/

SmallThinker-21B-A3B-Instruct-MXFP4_MOE-GGUF

Text Generation

Model card Files Files and versions

SmallThinker-21B-A3B-Instruct-MXFP4_MOE-GGUF / README.md

noctrex's picture

Add files using upload-large-folder tool

5677a81 verified 19 days ago

|

history blame contribute delete

247 Bytes

	---
	pipeline_tag: text-generation
	base_model:
	- PowerInfer/SmallThinker-21BA3B-Instruct
	---
	This is a MXFP4_MOE quantization of the model SmallThinker-21BA3B-Instruct

	Original model: https://huggingface.co/PowerInfer/SmallThinker-21BA3B-Instruct