Commit History

Rename merges.txt to tokenizer/merges.txt
56bcda1
verified

Girinath11 commited on

Rename vocab.json to tokenizer/vocab.json
76fe428
verified

Girinath11 commited on

Rename tokenizer_config.json to tokenizer/tokenizer_config.json
2e94e57
verified

Girinath11 commited on

Rename token_frequencies.pkl to tokenizer/token_frequencies.pkl
f79d2a8
verified

Girinath11 commited on