Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-snd-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
snd
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
main
monolingual-tokenizer-native-snd-vocab-128000
5.48 MB
1 contributor
History:
5 commits
Sai5480
Add README for snd tokenizer
75c7528
verified
about 1 month ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 month ago
README.md
612 Bytes
Add README for snd tokenizer
about 1 month ago
config.json
227 Bytes
Add config.json for snd tokenizer
about 1 month ago
snd.model
2.8 MB
xet
Add snd.model for snd tokenizer
about 1 month ago
snd.vocab
2.68 MB
Add snd.vocab for snd tokenizer
about 1 month ago
