Yalexis commited on
Commit
f2f7921
·
verified ·
1 Parent(s): 402ab37

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +54 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - gguf
5
+ - quantized
6
+ - llama.cpp
7
+ - ollama
8
+ base_model: Qwen/Qwen2.5-Coder-3B-Instruct
9
+ ---
10
+
11
+ # Yalexis/qwen2.5-coder-3b-b2b-website-gguf
12
+
13
+ This is a Q4_K_M quantized GGUF version of [Yalexis/qwen2.5-coder-3b-b2b-website](https://huggingface.co/Yalexis/qwen2.5-coder-3b-b2b-website).
14
+
15
+ ## Model Details
16
+
17
+ - **Base Model:** Qwen/Qwen2.5-Coder-3B-Instruct
18
+ - **Fine-tuned Model:** Yalexis/qwen2.5-coder-3b-b2b-website
19
+ - **Quantization:** Q4_K_M
20
+ - **Format:** GGUF
21
+ - **File Size:** 1.80 GB
22
+
23
+ ## Usage
24
+
25
+ ### Ollama
26
+
27
+ 1. Create a Modelfile:
28
+ ```
29
+ FROM ./qwen2.5-coder-3b-b2b-website-q4_k_m.gguf
30
+ ```
31
+
32
+ 2. Create the model:
33
+ ```bash
34
+ ollama create qwen-b2b-website -f Modelfile
35
+ ```
36
+
37
+ 3. Run the model:
38
+ ```bash
39
+ ollama run qwen-b2b-website
40
+ ```
41
+
42
+ ### llama.cpp
43
+
44
+ ```bash
45
+ ./llama-cli -m qwen2.5-coder-3b-b2b-website-q4_k_m.gguf -p "Your prompt here"
46
+ ```
47
+
48
+ ### LM Studio
49
+
50
+ Simply download this model in LM Studio and start chatting!
51
+
52
+ ## Model Information
53
+
54
+ This model was fine-tuned for B2B website generation with a 10k token context window.