arogister commited on
Commit
626a8f5
·
verified ·
1 Parent(s): 6eba57f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +94 -0
README.md ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: transformers
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - shining-valiant
8
+ - shining-valiant-3
9
+ - valiant
10
+ - valiant-labs
11
+ - qwen
12
+ - qwen-3
13
+ - qwen-3-8b
14
+ - 8b
15
+ - reasoning
16
+ - code
17
+ - code-reasoning
18
+ - science
19
+ - science-reasoning
20
+ - physics
21
+ - biology
22
+ - chemistry
23
+ - earth-science
24
+ - astronomy
25
+ - machine-learning
26
+ - artificial-intelligence
27
+ - compsci
28
+ - computer-science
29
+ - information-theory
30
+ - ML-Ops
31
+ - math
32
+ - cuda
33
+ - deep-learning
34
+ - transformers
35
+ - agentic
36
+ - LLM
37
+ - neuromorphic
38
+ - self-improvement
39
+ - complex-systems
40
+ - cognition
41
+ - linguistics
42
+ - philosophy
43
+ - logic
44
+ - epistemology
45
+ - simulation
46
+ - game-theory
47
+ - knowledge-management
48
+ - creativity
49
+ - problem-solving
50
+ - architect
51
+ - engineer
52
+ - developer
53
+ - creative
54
+ - analytical
55
+ - expert
56
+ - rationality
57
+ - conversational
58
+ - chat
59
+ - instruct
60
+ - mlx
61
+ - mlx-my-repo
62
+ base_model: ValiantLabs/Qwen3-8B-ShiningValiant3
63
+ datasets:
64
+ - sequelbox/Celestia3-DeepSeek-R1-0528
65
+ - sequelbox/Mitakihara-DeepSeek-R1-0528
66
+ - sequelbox/Raiden-DeepSeek-R1
67
+ license: apache-2.0
68
+ ---
69
+
70
+ # arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit
71
+
72
+ The Model [arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit](https://huggingface.co/arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit) was converted to MLX format from [ValiantLabs/Qwen3-8B-ShiningValiant3](https://huggingface.co/ValiantLabs/Qwen3-8B-ShiningValiant3) using mlx-lm version **0.26.4**.
73
+
74
+ ## Use with mlx
75
+
76
+ ```bash
77
+ pip install mlx-lm
78
+ ```
79
+
80
+ ```python
81
+ from mlx_lm import load, generate
82
+
83
+ model, tokenizer = load("arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit")
84
+
85
+ prompt="hello"
86
+
87
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
88
+ messages = [{"role": "user", "content": prompt}]
89
+ prompt = tokenizer.apply_chat_template(
90
+ messages, tokenize=False, add_generation_prompt=True
91
+ )
92
+
93
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
94
+ ```