Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-ori-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
ori
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
7779dd0
monolingual-tokenizer-native-ori-vocab-128000
7.99 MB
1 contributor
History:
4 commits
Sai5480
Add config.json for ori tokenizer
7779dd0
verified
28 days ago
.gitattributes
Safe
1.52 kB
initial commit
28 days ago
config.json
227 Bytes
Add config.json for ori tokenizer
28 days ago
ori.model
4.06 MB
xet
Add ori.model for ori tokenizer
28 days ago
ori.vocab
3.93 MB
Add ori.vocab for ori tokenizer
28 days ago