ByteSpan Tokenisers

non-profit

AI & ML interests

None defined yet.

Recent Activity

suchirsalhan authored a paper 13 days ago

BLiSS 1.0: Evaluating Bilingual Learner Competence in Second Language Small Language Models

suchirsalhan authored a paper 13 days ago

What is the Best Sequence Length for BABYLM?

suchirsalhan authored a paper 13 days ago

Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interaction

View all activity

models 12

ByteSpanTokenisers/fineweb-models

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalGlobalIncrement_64000

Updated Jun 29 • 151

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_BPEWP_64000

Updated Jun 23 • 193

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalMonotonicFrequency_64000

Updated Jun 23 • 201

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalCombinedSeeding_64000

Updated Jun 23 • 194

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalCombinedFrequency_64000

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_fw57M_Surprisal_bytespanP1-0_64000

Updated Jun 23 • 191

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalMonotonicSeeding_64000

Updated Jun 23 • 73

ByteSpanTokenisers/tokenizers

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_BPE_64000

datasets 2

ByteSpanTokenisers/common-corpus

Viewer • Updated Jun 24 • 820k • 27

ByteSpanTokenisers/finewebedu-20B

Viewer • Updated Jun 23 • 162M • 1.32k