mob2711 commited on
Commit
44d0005
·
verified ·
1 Parent(s): bd9d32f

Model save

Browse files
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: peft
4
+ tags:
5
+ - trl
6
+ - sft
7
+ - generated_from_trainer
8
+ base_model: openlm-research/open_llama_3b_v2
9
+ model-index:
10
+ - name: openllama_3b_en_vi
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # openllama_3b_en_vi
18
+
19
+ This model is a fine-tuned version of [openlm-research/open_llama_3b_v2](https://huggingface.co/openlm-research/open_llama_3b_v2) on an unknown dataset.
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 0.0002
39
+ - train_batch_size: 8
40
+ - eval_batch_size: 8
41
+ - seed: 3407
42
+ - gradient_accumulation_steps: 4
43
+ - total_train_batch_size: 32
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_steps: 5
47
+ - num_epochs: 1
48
+ - mixed_precision_training: Native AMP
49
+
50
+ ### Framework versions
51
+
52
+ - PEFT 0.10.0
53
+ - Transformers 4.39.3
54
+ - Pytorch 2.2.1
55
+ - Datasets 2.18.0
56
+ - Tokenizers 0.15.2
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b76eecaf1c44ae64330c4334e853ee0937643d2a5f87833e6c7acdf51e6f97f1
3
  size 513606016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2719a19904d309c19cbfd47b450718a97999f566e2dd0db990d6c2da4c03e73f
3
  size 513606016
runs/Apr08_10-21-38_ubuntu/events.out.tfevents.1712546499.ubuntu CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5195f66a36e1ba486edac4c6efe7ecb135388452de62e2d51a765d909ea4bc3a
3
- size 47092
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca91f521151ed34dd103131f83ebd3b4564a277bdc9b1d22f3adcba802533afa
3
+ size 48712