Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-iso-ben-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
ben
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
main
monolingual-tokenizer-iso-ben-vocab-128000
5.86 MB
1 contributor
History:
5 commits
Sai5480
Add README for ben tokenizer
e407494
verified
2 months ago
.gitattributes
Safe
1.52 kB
initial commit
2 months ago
README.md
612 Bytes
Add README for ben tokenizer
2 months ago
ben.model
2.99 MB
xet
Add ben.model for ben tokenizer
2 months ago
ben.vocab
2.87 MB
Add ben.vocab for ben tokenizer
2 months ago
config.json
227 Bytes
Add config.json for ben tokenizer
2 months ago
