MaziyarPanahi
/

gemma-3-12b-it-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions

gemma-3-12b-it-GGUF

99.3 GB

1 contributor

History: 3 commits

MaziyarPanahi's picture

Upload folder using huggingface_hub

0e7c92b verified 8 months ago

.gitattributes

2.2 kB

Upload folder using huggingface_hub 8 months ago
README.md

2.89 kB

Upload folder using huggingface_hub 8 months ago
config.json

31 Bytes

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q2_K.gguf

4.77 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q3_K_L.gguf

6.48 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q3_K_M.gguf

6.01 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q3_K_S.gguf

5.46 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q4_K_M.gguf

7.3 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q4_K_S.gguf

6.94 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q5_K_M.gguf

8.44 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q5_K_S.gguf

8.23 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q6_K.gguf

9.66 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.Q8_0.gguf

12.5 GB
xet

Upload folder using huggingface_hub 8 months ago
gemma-3-12b-it.fp16.gguf

23.5 GB
xet

Upload folder using huggingface_hub 8 months ago