Multilingual UnigramLM

company

https://cimeister.github.io/blog/unigramlm/

AI & ML interests

Multilingual Tokenization

Recent Activity

suchirsalhan updated a model 8 days ago

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-khm

suchirsalhan published a model 8 days ago

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-khm

suchirsalhan updated a model 8 days ago

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-tam

View all activity

MultilingualUnigramLM 's datasets 32

MultilingualUnigramLM/FineWeb2-khm_Khmr-100M

Viewer • Updated 8 days ago • 1.01M • 11

MultilingualUnigramLM/FineWeb2-tha_Thai-100M

Viewer • Updated 8 days ago • 710k • 11

MultilingualUnigramLM/FineWeb2-tam_Taml-100M

Viewer • Updated 8 days ago • 264k • 10

MultilingualUnigramLM/FineWeb2-arb_Arab-100M

Viewer • Updated 8 days ago • 188k • 9

MultilingualUnigramLM/FineWeb2-ben_Beng-100M

Viewer • Updated 8 days ago • 254k • 9

MultilingualUnigramLM/FineWeb2-amh_Ethi-100M

Viewer • Updated 8 days ago • 197k • 9

MultilingualUnigramLM/FineWeb2-yor_Latn-100M

Viewer • Updated 8 days ago • 80k • 9

MultilingualUnigramLM/FineWeb2-wol_Latn-100M

Viewer • Updated 8 days ago • 6.62k • 9

MultilingualUnigramLM/FineWeb2-hin_Deva-100M

Viewer • Updated 8 days ago • 193k • 13

MultilingualUnigramLM/FineWeb2-swh_Latn-100M

Viewer • Updated 8 days ago • 240k • 11

MultilingualUnigramLM/FineWeb2-deu_Latn-100M

Viewer • Updated 8 days ago • 234k • 13

MultilingualUnigramLM/FineWeb2-tur_Latn-100M

Viewer • Updated 10 days ago • 263k • 45

MultilingualUnigramLM/FineWeb2-fin_Latn-100M

Viewer • Updated 10 days ago • 261k • 46

MultilingualUnigramLM/FineWeb2-hun_Latn-100M

Viewer • Updated 10 days ago • 198k • 43

MultilingualUnigramLM/LangMap-TheStack-go-100M

Viewer • Updated about 1 month ago • 35k • 29

MultilingualUnigramLM/LangMap-TheStack-typescript-100M

Viewer • Updated about 1 month ago • 64.2k • 28

MultilingualUnigramLM/LangMap-TheStack-markdown-100M

Viewer • Updated about 1 month ago • 56.5k • 35

MultilingualUnigramLM/LangMap-TheStack-css-100M

Viewer • Updated about 1 month ago • 18.6k • 27

MultilingualUnigramLM/LangMap-TheStack-html-100M

Viewer • Updated about 1 month ago • 20.3k • 32

MultilingualUnigramLM/LangMap-TheStack-php-100M

Viewer • Updated about 1 month ago • 78.3k • 32

MultilingualUnigramLM/LangMap-TheStack-csharp-100M

Viewer • Updated about 1 month ago • 79.5k • 94 • 1

MultilingualUnigramLM/LangMap-TheStack-cpp-100M

Viewer • Updated about 1 month ago • 26.4k • 21

MultilingualUnigramLM/LangMap-TheStack-c-100M

Viewer • Updated about 1 month ago • 28.6k • 21

MultilingualUnigramLM/LangMap-TheStack-java-100M

Viewer • Updated about 1 month ago • 73k • 74

MultilingualUnigramLM/LangMap-TheStack-javascript-100M

Viewer • Updated about 1 month ago • 47.4k • 23

MultilingualUnigramLM/LangMap-TheStack-python-100M

Viewer • Updated about 1 month ago • 49.9k • 62 • 1

MultilingualUnigramLM/FineWeb2-100M

Updated Apr 11 • 6

MultilingualUnigramLM/The-Stack-10K

Viewer • Updated Apr 4 • 300k • 39

MultilingualUnigramLM/FineWeb2-100M-olmo3-7b-toks

Viewer • Updated Mar 14 • 1.22M • 48

MultilingualUnigramLM/FineWeb2-10M

Viewer • Updated Jan 20 • 228k • 3