unsloth
/

DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

error : unknown data type:U8

#4 opened 9 months ago by

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened 9 months ago by

How to convert this model to GGUF?

#2 opened 9 months ago by

The `tokenizer_config.json` is missing the `chat_template` jinja?

#1 opened 10 months ago by