alphaaico commited on
Commit
260d806
·
verified ·
1 Parent(s): 868c36d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -5
README.md CHANGED
@@ -1,12 +1,11 @@
1
  ---
2
- base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
  - llama
8
- - trl
9
- - sft
10
  license: apache-2.0
11
  language:
12
  - en
@@ -16,8 +15,46 @@ language:
16
 
17
  - **Developed by:** alphaaico
18
  - **License:** apache-2.0
19
- - **Finetuned from model :** unsloth/llama-3.2-3b-instruct-bnb-4bit
20
 
21
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: llama-3.2-3b-instruct-bnb-4bit
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
  - llama
8
+ - gguf
 
9
  license: apache-2.0
10
  language:
11
  - en
 
15
 
16
  - **Developed by:** alphaaico
17
  - **License:** apache-2.0
18
+ - **Finetuned from model :** llama-3.2-3b-instruct-bnb-4bit
19
 
20
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
+ **AlphaAI-Chatty-INT1**
23
+
24
+ Overview
25
+ AlphaAI-Chatty-INT1 is a fine-tuned LLaMA 3B Small model optimized for chatty and engaging conversations. This model has been trained on a proprietary conversational dataset, making it well-suited for local deployments that require a natural, interactive dialogue experience.
26
+
27
+ The model is available in GGUF format and has been quantized to different levels to support various hardware configurations.
28
+
29
+ **Model Details**
30
+ - Base Model: LLaMA 3B Small
31
+ - Fine-tuned By: Alpha AI
32
+ - Training Framework: Unsloth
33
+
34
+ Quantization Levels Available:
35
+ - q4_k_m
36
+ - q5_k_m
37
+ - q8_0
38
+ - 16-bit (full precision) https://huggingface.co/alphaaico/AlphaAI-Chatty-INT1-16bit
39
+
40
+ Format: GGUF (Optimized for local deployments)
41
+
42
+ Use Cases:
43
+ - Conversational AI – Ideal for chatbots, virtual assistants, and customer support.
44
+ - Local AI Deployments – Runs efficiently on local machines without requiring cloud-based inference.
45
+ - Research & Experimentation – Suitable for studying conversational AI and fine-tuning on domain-specific datasets.
46
+
47
+ Model Performance
48
+ The model has been optimized for chat-style interactions, ensuring:
49
+ - Engaging and context-aware responses
50
+ - Efficient performance on consumer hardware
51
+ - Balanced coherence and creativity in conversations
52
+
53
+ Limitations & Biases
54
+ This model, like any AI system, may have biases from the training data. It is recommended to use it responsibly and fine-tune further if needed for specific applications.
55
+
56
+ License
57
+ This model is released under a permissible license. Please check the Hugging Face repository for more details.
58
+
59
+ Acknowledgments
60
+ Special thanks to the Unsloth team for providing an optimized training pipeline for LLaMA models.