metadata
license: mit
base_model:
- deepseek-ai/DeepSeek-R1
- unsloth/DeepSeek-R1-GGUF
Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.
license: mit
base_model:
- deepseek-ai/DeepSeek-R1
- unsloth/DeepSeek-R1-GGUF
Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.