OddTheGreat commited on
Commit
11737ff
·
verified ·
1 Parent(s): 5f5f306

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -59
README.md CHANGED
@@ -1,59 +1,21 @@
1
- ---
2
- base_model:
3
- - Delta-Vector/Rei-24B-KTO
4
- - zerofata/MS3.2-PaintedFantasy-v2-24B
5
- - OddTheGreat/Mechanism_24B_V.1
6
- - Doctor-Shotgun/MS3.2-24B-Magnum-Diamond
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
-
12
- ---
13
- # Textolite_24B_V.2
14
-
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [OddTheGreat/Mechanism_24B_V.1](https://huggingface.co/OddTheGreat/Mechanism_24B_V.1) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [Delta-Vector/Rei-24B-KTO](https://huggingface.co/Delta-Vector/Rei-24B-KTO)
26
- * [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B)
27
- * [Doctor-Shotgun/MS3.2-24B-Magnum-Diamond](https://huggingface.co/Doctor-Shotgun/MS3.2-24B-Magnum-Diamond)
28
-
29
- ### Configuration
30
-
31
- The following YAML configuration was used to produce this model:
32
-
33
- ```yaml
34
- models:
35
- - model: Delta-Vector/Rei-24B-KTO
36
- parameters:
37
- density: 0.25
38
- weight: 0.25
39
- - model: OddTheGreat/Mechanism_24B_V.1
40
- parameters:
41
- density: 0.25
42
- weight: 0.25
43
- - model: zerofata/MS3.2-PaintedFantasy-v2-24B
44
- parameters:
45
- density: 0.25
46
- weight: 0.25
47
- - model: Doctor-Shotgun/MS3.2-24B-Magnum-Diamond
48
- parameters:
49
- density: 0.25
50
- weight: 0.25
51
- merge_method: ties
52
- base_model: OddTheGreat/Mechanism_24B_V.1
53
- parameters:
54
- normalize: false
55
- int8_mask: false
56
- dtype: float16
57
- tokenizer:
58
- source: union
59
- ```
 
1
+ ---
2
+ base_model:
3
+ - Delta-Vector/Rei-24B-KTO
4
+ - zerofata/MS3.2-PaintedFantasy-v2-24B
5
+ - OddTheGreat/Mechanism_24B_V.1
6
+ - Doctor-Shotgun/MS3.2-24B-Magnum-Diamond
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+
12
+ ---
13
+ # Textolite_24B_V.2
14
+
15
+ This is a merge of pre-trained language models
16
+
17
+ Goal of this merge was to create good roleplay model, for "adventure" and "life sim" type of roleplay.
18
+
19
+ Model is stable, with good attention to context and decent instruction-following capabilities.
20
+
21
+ Tested on mistral v7-tekken. T1.01