sbintuitions
/

sarashina2-70b

Model card Files Files and versions

sho-takase commited on Aug 6, 2024

Commit

d80a689

·

verified ·

1 Parent(s): aa01651

Revise readme

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -41,7 +41,7 @@ for t in text:
 | :-----: | :-----------: | :-------------:  | :------------ | :-----------: | :----: | :--------: | :-------------: |
 | [7B](https://huggingface.co/sbintuitions/sarashina2-7b)      | 102400        | 2.1T             | Llama2        | RoPE          | 32     | 4096       | 32 |
 | [13B](https://huggingface.co/sbintuitions/sarashina2-13b)    | 102400        | 2.1T             | Llama2        | RoPE          | 40     | 5120       | 40 |
-| [13B](https://huggingface.co/sbintuitions/sarashina2-70b)    | 102400        | 2.1T             | Llama2        | RoPE          | 80     | 8192       | 64 |
 ## Training Corpus

 | :-----: | :-----------: | :-------------:  | :------------ | :-----------: | :----: | :--------: | :-------------: |
 | [7B](https://huggingface.co/sbintuitions/sarashina2-7b)      | 102400        | 2.1T             | Llama2        | RoPE          | 32     | 4096       | 32 |
 | [13B](https://huggingface.co/sbintuitions/sarashina2-13b)    | 102400        | 2.1T             | Llama2        | RoPE          | 40     | 5120       | 40 |
+| [70B](https://huggingface.co/sbintuitions/sarashina2-70b)    | 102400        | 2.1T             | Llama2        | RoPE          | 80     | 8192       | 64 |
 ## Training Corpus