Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-ori-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
ori
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
7779dd0
monolingual-tokenizer-native-ori-vocab-128000
Commit History
Add config.json for ori tokenizer
7779dd0
verified
Sai5480
commited on
29 days ago
Add ori.vocab for ori tokenizer
4f3ee67
verified
Sai5480
commited on
29 days ago
Add ori.model for ori tokenizer
901dcc3
verified
Sai5480
commited on
29 days ago
initial commit
909cac3
verified
Sai5480
commited on
29 days ago