Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Sai5480
/
monolingual-tokenizer-native-hin-vocab-128000

sentencepiece
tokenizer
monolingual
hin
vocab-128000
Model card Files Files and versions
xet
Community
monolingual-tokenizer-native-hin-vocab-128000
7.42 MB
  • 1 contributor
History: 5 commits
Sai5480's picture
Sai5480
Add README for hin tokenizer
9009360 verified 28 days ago
  • .gitattributes
    1.52 kB
    initial commit 28 days ago
  • README.md
    609 Bytes
    Add README for hin tokenizer 28 days ago
  • config.json
    227 Bytes
    Add config.json for hin tokenizer 28 days ago
  • hin.model
    3.77 MB
    xet
    Add hin.model for hin tokenizer 28 days ago
  • hin.vocab
    3.65 MB
    Add hin.vocab for hin tokenizer 28 days ago