ggml-org
/

pixtral-12b-GGUF

Model card Files Files and versions

pixtral-12b

Original model: https://huggingface.co/mistral-community/pixtral-12b

For more info, please refer to this PR: https://github.com/ggml-org/llama.cpp/pull/13065

Downloads last month: 3,698

GGUF

Model size

12B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

2-bit

4-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/pixtral-12b-GGUF

Base model

mistral-community/pixtral-12b

Quantized

(13)

this model

Quantizations

1 model

Collection including ggml-org/pixtral-12b-GGUF

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli • 13 items • Updated Aug 20 • 12