Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-ori-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
ori
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
main
monolingual-tokenizer-native-ori-vocab-128000
7.99 MB
1 contributor
History:
5 commits
Sai5480
Add README for ori tokenizer
757c247
verified
27 days ago
.gitattributes
Safe
1.52 kB
initial commit
27 days ago
README.md
606 Bytes
Add README for ori tokenizer
27 days ago
config.json
227 Bytes
Add config.json for ori tokenizer
27 days ago
ori.model
4.06 MB
xet
Add ori.model for ori tokenizer
27 days ago
ori.vocab
3.93 MB
Add ori.vocab for ori tokenizer
27 days ago
