Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-hin-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
hin
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
82f5393
monolingual-tokenizer-native-hin-vocab-128000
/
hin.vocab
Sai5480
Add hin.vocab for hin tokenizer
82f5393
verified
about 1 month ago
raw
Copy download link
history
3.65 MB
File too large to display, you can
check the raw version
instead.