matrixportalx's picture
Upload README.md with huggingface_hub
20110e7 verified
|
raw
history blame
2.79 kB
metadata
base_model: google/gemma-3-270m-it
language:
  - tr
  - en
library_name: transformers
license: apache-2.0
tags:
  - matrixportal
inference: false

gemma-3-270m-it-tr GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 6314 (a8bca68f)

Model Information

Available Files

πŸš€ Download πŸ”’ Type πŸ“ Description
Download Q2 K Tiny size, lowest quality (emergency use only)
Download Q3 K S Very small, low quality (basic tasks)
Download Q3 K M Small, acceptable quality
Download Q3 K L Small, better than Q3_K_M (good for low RAM)
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K S 4-bit optimized (good space savings)
Download Q4 K M 4-bit balanced (recommended default)
Download Q5 0 5-bit high quality
Download Q5 K S 5-bit optimized
Download Q5 K M 5-bit best (recommended HQ option)
Download Q6 K 6-bit near-perfect (premium quality)
Download Q8 0 8-bit maximum (overkill for most)
Download F16 Full precision (maximum accuracy)

πŸ’‘ Q4 K M provides the best balance for most use cases