avemio
/

German-RAG-PHI-3.5-MINI-4B-SFT-HESSIAN-AI

Question Answering

Question-Answering

Model card Files Files and versions

avemio-digital commited on Dec 4, 2024

Commit

a734d77

·

verified ·

1 Parent(s): da56574

Update README.md

Files changed (1) hide show

README.md +8 -9

README.md CHANGED Viewed

@@ -134,15 +134,14 @@ For training data details, please see the [GRAG-SFT-Dataset](https://huggingface
 ### Hyperparameters
-|                       | **GRAG-PHI-SFT**  |
-|-----------------------|------------------|---------------------|--------------------|--------------------|
-| warmup steps          | 50             |
-| peak LR               | 5.0E-07 |
-| weight decay          | 0.1              |
-| LR schedule           | linear           |
-| gradient reduce dtype | FP32             |
-| optimizer state dtype | FP32             |
 ## Environmental Impact

 ### Hyperparameters
+| Parameter                 | GRAG-PHI-SFT       |
+|---------------------------|--------------------|
+| **warmup steps**          | 50                |
+| **peak LR**               | 5.0E-07           |
+| **weight decay**          | 0.1               |
+| **LR schedule**           | linear            |
+| **gradient reduce dtype** | FP32              |
+| **optimizer state dtype** | FP32              |
 ## Environmental Impact