Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
lightonai 's Collections
LightOnOCR
Embeddings datasets ⚡️
PyLate 🐕
ModernBERT
PAGnol 🇫🇷
RITA 🧿
Mamba 🐍
ArabicWeb24-ablation-models

ModernBERT

updated May 26

Bringing BERT into modernity via both architecture changes and scaling

Upvote
3

  • answerdotai/ModernBERT-base

    Fill-Mask • 0.1B • Updated Jan 15 • 782k • 955

  • lightonai/GTE-ModernColBERT-v1

    Sentence Similarity • 0.1B • Updated Sep 10 • 8.02k • • 144

  • lightonai/Reason-ModernColBERT

    Sentence Similarity • 0.1B • Updated Sep 9 • 4.91k • • 206

  • lightonai/modernbert-embed-large

    Sentence Similarity • 0.4B • Updated May 14 • 5.87k • • 27

  • answerdotai/ModernBERT-large

    Fill-Mask • 0.4B • Updated Jan 15 • 72.8k • 431

  • Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

    Paper • 2412.13663 • Published Dec 18, 2024 • 157
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs