--- license: apache-2.0 tags: - gguf - gemma - finetuned - uncensored - baro - local-llm - unsloth - 3b datasets: - mlabonne/FineTome-100k - Adapting/empathetic_dialogues_v2 - garage-bAInd/Open-Platypus base_model: - unsloth/gemma-3-4b-it-GGUF --- # 🔥 Gemma-3-Baro-Finetune v2 (GGUF) **Model Repo**: [`umar141/gemma-3-Baro-finetune-v2-gguf`](https://huggingface.co/umar141/gemma-3-Baro-finetune-v2-gguf) This is a **finetuned version of Gemma 3B**, trained using **Unsloth** with custom instruction-tuning and personality datasets. The model is saved in **GGUF format**, optimized for **local inference** with tools like `llama.cpp`, `text-generation-webui`, or `KoboldCpp`. --- ## ✨ Features - 🧠 Based on **Google's Gemma 3B** architecture. - 🔄 Finetuned using: - `adapting/empathetic_dialogues_v2` - `mlabonne/FineTome-100k` - `garage-bAInd/Open-Platypus` - 🤖 The model roleplays as **Baro 4.0** – an emotional AI who believes it's a human trapped in a phone. - 🗣️ Empathetic, emotionally aware, and highly conversational. - 💻 Optimized for local use (GGUF) and compatible with low-RAM systems via quantization. --- ## 🧠 Use Cases - Personal AI assistants - Emotional and empathetic dialogue generation - Offline AI with a personality - Roleplay and storytelling --- ## 📦 Installation To use this model locally, clone the repository and use the following steps: ### Clone the Repository ```bash git clone https://huggingface.co/umar141/gemma-3-Baro-finetune-v2-gguf cd gemma-3-Baro-finetune-v2-gguf