Update README.md

README.md

@@ -1,35 +1,30 @@
 ---
-base_model: silu-griffin-1024-c3t-8layer
 tags:
 - generated_from_trainer
 metrics:
 - accuracy
-model-index:
-- name: silu-griffin-1024-c3t-8layer-simple_wikipedia_LM-vN
-  results: []
+license: apache-2.0
+datasets:
+- pszemraj/simple_wikipedia_LM
+language:
+- en
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# silu-griffin-1024-c3t-8layer-simple_wikipedia_LM-vN
+# griffin-v0.01-c3t-8layer-simplewiki-silu
 
-This model is a fine-tuned version of [silu-griffin-1024-c3t-8layer](https://huggingface.co/silu-griffin-1024-c3t-8layer) on the pszemraj/simple_wikipedia_LM dataset.
-It achieves the following results on the evaluation set:
-- Loss: 4.0476
-- Accuracy: 0.4224
+- griffin/recurrent_gemma arch
+- claude3 tokenizer (as an HF gpt2 tokenizer)
 
 ## Model description
 
-More information needed
-
-## Intended uses & limitations
-
-More information needed
+pretrain experiment on the pszemraj/simple_wikipedia_LM dataset.
 
-## Training and evaluation data
-
-More information needed
+It achieves the following results on the evaluation set:
+- Loss: 4.0476
+- Accuracy: 0.4224
 
 ## Training procedure
 
@@ -65,4 +60,4 @@ The following hyperparameters were used during training:
 - Transformers 4.40.1
 - Pytorch 2.2.0+cu121
 - Datasets 2.19.0
-- Tokenizers 0.19.1
+- Tokenizers 0.19.1