Commit History

Rename special_tokens_map.json to english_tokenizer/special_tokens_map.json
c779b0b

Yanisadel commited on

Rename tokenizer_config.json to english_tokenizer/tokenizer_config.json
6e86071

Yanisadel commited on

Rename tokenizer.model to english_tokenizer/tokenizer.model
cac0bdc

Yanisadel commited on

Rename tokenizer.json to english_tokenizer/tokenizer.json
0f0c644

Yanisadel commited on

Rename added_tokens.json to english_tokenizer/added_tokens.json
058ea56

Yanisadel commited on

Upload tokenizer
9654d01

Yanisadel commited on

initial commit
140befc

Yanisadel commited on