FydeRobot commited on
Commit
ef7718a
·
verified ·
1 Parent(s): b8c76c3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +98 -0
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license_name: tongyi-qianwen-research
3
+ license_link: LICENSE
4
+ language:
5
+ - en
6
+ - zh
7
+ tags:
8
+ - qwen
9
+ - rkllm
10
+ - rk3588
11
+ - Rockchip
12
+ license: other
13
+ ---
14
+
15
+ # Qwen2-1_5B-Chat_rkLLM
16
+
17
+ - [English](#qwen2-1_5b_rkllm)
18
+ - [中文](#通义千问2-1_5b)
19
+
20
+ ## Qwen2-1_5B-Chat_rkLLM
21
+
22
+ ### Introduction
23
+
24
+ Qwen2-1_5B-Chat_rkLLM is a model converted from [Qwen2-1_5B](https://huggingface.co/Qwen/Qwen2-1_5B/), optimized for Rockchip devices. This model runs on the NPU of the RK3588 chip.
25
+
26
+ - **Model Name**: Qwen2-1_5B
27
+ - **Architecture**: Same as Qwen2-1_5B
28
+ - **Publisher**: FydeOS
29
+ - **Release Date**: May 14, 2024
30
+
31
+ ### Model Details
32
+
33
+ Qwen2-1_5B-Chat_rkLLM is part of the Tongyi Qianwen series developed by Alibaba. This large language model features 1.8 billion parameters and is based on the Transformer architecture. It has been pre-trained on a diverse dataset, including web texts, professional literature, and code.
34
+
35
+ ### User Guide
36
+
37
+ This model is supported only on devices with the Rockchip RK3588/s chip. Please verify your device’s chip information and ensure the NPU is operational.
38
+
39
+ #### openFyde
40
+
41
+ > Ensure you have upgraded to the latest version of openFyde.
42
+
43
+ 1. Download the model file `XXX.rkllm`.
44
+ 2. Create a folder named `model/` and place the model file inside this folder.
45
+ 3. Launch FydeOS AI and configure the settings on the settings page.
46
+
47
+ #### Other OS
48
+
49
+ > Ensure you have updated the NPU kernel related to RKLLM.
50
+
51
+ 1. Download the model file `XXX.rkllm`.
52
+ 2. Follow the configuration guidelines in the [official documentation](https://github.com/airockchip/rknn-llm).
53
+
54
+ ### Limitations and Considerations
55
+
56
+ - The model may have performance limitations in certain scenarios.
57
+ - Ensure compliance with relevant laws and regulations during usage.
58
+ - Parameter tuning might be necessary to achieve optimal performance.
59
+
60
+ ## 通义千问2-1_5B
61
+
62
+ ### 介绍
63
+
64
+ 通义千问2-1_5B 是从 [Qwen2-1.5B](https://huggingface.co/Qwen/Qwen2-1.5B) 转换而来的 RKLLM 模型,专为 Rockchip 设备优化。该模型运行于 RK3588 的 NPU 上。
65
+
66
+ - **模型名称**: Qwen2-1_5B
67
+ - **模型架构**: 与 Qwen2-1_5B 相同
68
+ - **发布者**: FydeOS
69
+ - **发布日期**: 2024-07-12
70
+
71
+ ### 模型详情
72
+
73
+ 通义千问-1.5B(Qwen2-1_5B)是阿里云研发的通义千问系列大模型中的一员,拥有 15 亿参数。该模型基于 Transformer 架构,经过大规模预训练,涵盖了多种类型的数据,包括网络文本、专业书籍和代码。
74
+
75
+ ### 使用指南
76
+
77
+ 此模型仅支持搭载 Rockchip RK3588/s 芯片的设备。请确认设备信息并确保 NPU 可用。
78
+
79
+ #### openFyde 系统
80
+
81
+ > 请确保你已将系统升级到最新版本。
82
+
83
+ 1. 下载模型文件 `XXX.rkllm`。
84
+ 2. 新建文件夹 `model/`,将模型文件放置于该文件夹内。
85
+ 3. 启动 FydeOS AI,在设置页面进行相关配置。
86
+
87
+ #### 其它系统
88
+
89
+ > 请确保已完成 RKLLM 的 NPU 相关内核更新。
90
+
91
+ 1. 下载模型文件 `XXX.rkllm`。
92
+ 2. 按照官方文档进行配置:[官方文档](https://github.com/airockchip/rknn-llm)。
93
+
94
+ ### 限制与注意事项
95
+
96
+ - 模型在某些情况下可能存在性能限制
97
+ - 使用时请遵循相关法律法规
98
+ - 可能需要进行适当的参数调优以达到最佳效果