geoffmunn/Qwen3Guard-Gen-4B-GGUF at main

Qwen3Guard-Gen-4B-GGUF

26 GB

1 contributor

History: 2 commits

geoffmunn

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload

c510220 verified about 2 months ago

Qwen3Guard-Gen-4B-Q2_K
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q3_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q3_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q4_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q4_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q5_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q5_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q6_K
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-Q8_0
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
.gitattributes

2.14 kB

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
MODELFILE

574 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q2_K.gguf

1.8 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q3_K_M.gguf

2.24 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q3_K_S.gguf

2.05 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q4_K_M.gguf

2.72 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q4_K_S.gguf

2.6 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q5_K_M.gguf

3.16 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q5_K_S.gguf

3.09 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q6_K.gguf

3.63 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
Qwen3Guard-Gen-4B-f16:Q8_0.gguf

4.69 GB
xet

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
README.md

2.75 kB

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago
SHA256SUMS.txt

894 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload about 2 months ago