matrixportalx commited on
Commit
20110e7
·
verified ·
1 Parent(s): 34dd51a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: google/gemma-3-270m-it
3
+ language:
4
+ - tr
5
+ - en
6
+ library_name: transformers
7
+ license: apache-2.0
8
+ tags:
9
+ - matrixportal
10
+ inference: false
11
+ ---
12
+
13
+ # gemma-3-270m-it-tr GGUF Quantized Models
14
+
15
+ ## Technical Details
16
+ - **Quantization Tool:** llama.cpp
17
+ - **Version:** version: 6314 (a8bca68f)
18
+
19
+ ## Model Information
20
+ - **Base Model:** [matrixportalx/gemma-3-270m-it-tr](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr)
21
+ - **Quantized by:** [matrixportalx](https://huggingface.co/matrixportalx)
22
+
23
+ ## Available Files
24
+ | 🚀 Download | 🔢 Type | 📝 Description |
25
+ |------------|---------|---------------|
26
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q2_k.gguf) | Q2 K | Tiny size, lowest quality (emergency use only) |
27
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q3_k_s.gguf) | Q3 K S | Very small, low quality (basic tasks) |
28
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q3_k_m.gguf) | Q3 K M | Small, acceptable quality |
29
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q3_k_l.gguf) | Q3 K L | Small, better than Q3_K_M (good for low RAM) |
30
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q4_0.gguf) | Q4 0 | Standard 4-bit (fast on ARM) |
31
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q4_k_s.gguf) | Q4 K S | 4-bit optimized (good space savings) |
32
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) |
33
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q5_0.gguf) | Q5 0 | 5-bit high quality |
34
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q5_k_s.gguf) | Q5 K S | 5-bit optimized |
35
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q5_k_m.gguf) | Q5 K M | 5-bit best (recommended HQ option) |
36
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q6_k.gguf) | Q6 K | 6-bit near-perfect (premium quality) |
37
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.q8_0.gguf) | Q8 0 | 8-bit maximum (overkill for most) |
38
+ | [Download](https://huggingface.co/matrixportalx/gemma-3-270m-it-tr-GGUF/resolve/main/gemma-3-270m-it-tr.f16.gguf) | F16 | Full precision (maximum accuracy) |
39
+
40
+ 💡 **Q4 K M** provides the best balance for most use cases