aliarda
/

turkish_tokenizer_256k

byte-pair-encoding

Model card Files Files and versions

turkish_tokenizer_256k

32 MB

1 contributor

History: 2 commits

aliarda's picture

Upload tokenizer

feeb674 verified 12 months ago