SlayerLab
/

TokenizerTest-32m-B

Text Generation

tokenizer-comparison

Model card Files Files and versions

TokenizerTest-32m-B

2.07 GB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

Maggio33's picture

Add training recipe/script (README.md, SHA256SUMS)

92995f0 verified 9 days ago

step_10000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_20000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_30000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_40000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_50000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_60000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_70000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_80000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
step_90000
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
.gitattributes

1.52 kB
initial commit 9 days ago
README.md

6.78 kB
Add training recipe/script (README.md, SHA256SUMS) 9 days ago
SHA256SUMS

2.97 kB
Add training recipe/script (README.md, SHA256SUMS) 9 days ago
bpb_curve.json

2.38 kB
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
config.json

353 Bytes
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
model.safetensors

205 MB
xet

TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
modeling_gollem_v6.py

6.68 kB
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago
tokenizer.json

2.51 MB
TokenizerTest-32m-B: final + every-10k weights, card, bpb curve 9 days ago