Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Sai5480
/
monolingual-tokenizer-native-hin-vocab-128000

sentencepiece
tokenizer
monolingual
hin
vocab-128000
Model card Files Files and versions
xet
Community
monolingual-tokenizer-native-hin-vocab-128000
7.42 MB
  • 1 contributor
History: 3 commits
Sai5480's picture
Sai5480
Add hin.vocab for hin tokenizer
82f5393 verified about 1 month ago
  • .gitattributes
    1.52 kB
    initial commit about 1 month ago
  • hin.model
    3.77 MB
    xet
    Add hin.model for hin tokenizer about 1 month ago
  • hin.vocab
    3.65 MB
    Add hin.vocab for hin tokenizer about 1 month ago