Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-ori-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
ori
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
7779dd0
monolingual-tokenizer-native-ori-vocab-128000
/
ori.vocab
Commit History
Add ori.vocab for ori tokenizer
4f3ee67
verified
Sai5480
commited on
30 days ago