xlm-roberta-japanese-tokenizer-16k / tokenizer_config.json

Commit History

Upload tokenizer
1e838cc
verified

hotchpotch commited on