Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
diq
like
0
Follow
Wikilangs
14
Text Generation
fastText
omarkamali/wikipedia-monthly
Dimli (individual language)
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-iranian_other
License:
mit
Model card
Files
Files and versions
xet
Community
Use this model
main
diq
/
visualizations
2.99 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
omarkamali
Upload all models and assets for diq (latest)
e2fa0dc
verified
3 months ago
embedding_alignment_quality.png
48.6 kB
Upload all models and assets for diq (latest)
3 months ago
embedding_isotropy.png
46.7 kB
Upload all models and assets for diq (latest)
3 months ago
embedding_norms.png
36.2 kB
Upload all models and assets for diq (latest)
3 months ago
embedding_similarity.png
155 kB
xet
Upload all models and assets for diq (latest)
3 months ago
embedding_tsne_multilingual.png
316 kB
xet
Upload all models and assets for diq (latest)
3 months ago
markov_branching.png
36.4 kB
Upload all models and assets for diq (latest)
3 months ago
markov_contexts.png
38.7 kB
Upload all models and assets for diq (latest)
3 months ago
markov_entropy.png
81 kB
Upload all models and assets for diq (latest)
3 months ago
model_sizes.png
53.5 kB
Upload all models and assets for diq (latest)
3 months ago
nearest_neighbors.png
74 kB
Upload all models and assets for diq (20251201)
3 months ago
ngram_coverage.png
84.3 kB
Upload all models and assets for diq (latest)
3 months ago
ngram_entropy.png
48.4 kB
Upload all models and assets for diq (latest)
3 months ago
ngram_perplexity.png
65.9 kB
Upload all models and assets for diq (latest)
3 months ago
ngram_unique.png
33.7 kB
Upload all models and assets for diq (latest)
3 months ago
performance_dashboard.png
387 kB
xet
Upload all models and assets for diq (latest)
3 months ago
position_encoding_comparison.png
112 kB
xet
Upload all models and assets for diq (latest)
3 months ago
tokenizer_compression.png
48.8 kB
Upload all models and assets for diq (latest)
3 months ago
tokenizer_fertility.png
44.3 kB
Upload all models and assets for diq (latest)
3 months ago
tokenizer_oov.png
45 kB
Upload all models and assets for diq (latest)
3 months ago
tokenizer_total_tokens.png
45.1 kB
Upload all models and assets for diq (latest)
3 months ago
top20_words.png
57.7 kB
Upload all models and assets for diq (latest)
3 months ago
tsne_sentences.png
249 kB
xet
Upload all models and assets for diq (latest)
3 months ago
tsne_words.png
657 kB
xet
Upload all models and assets for diq (latest)
3 months ago
vocab_coverage.png
68.7 kB
Upload all models and assets for diq (latest)
3 months ago
vocab_freq_dist.png
53.1 kB
Upload all models and assets for diq (latest)
3 months ago
zipf_law.png
107 kB
xet
Upload all models and assets for diq (latest)
3 months ago
