teams-base-finewebs-1m / tokenizer_config.json

Commit History

tokenizer: add config and vocab
294ca7f
verified

stefan-it commited on