Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-snd-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
snd
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
main
monolingual-tokenizer-native-snd-vocab-128000
Commit History
Add README for snd tokenizer
75c7528
verified
Sai5480
commited on
Sep 23
Add config.json for snd tokenizer
2bbd687
verified
Sai5480
commited on
Sep 23
Add snd.vocab for snd tokenizer
ad587a0
verified
Sai5480
commited on
Sep 23
Add snd.model for snd tokenizer
9ebf815
verified
Sai5480
commited on
Sep 23
initial commit
581d0a8
verified
Sai5480
commited on
Sep 23