Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

datablations

https://github.com/huggingface/datablations
Activity Feed Request to join this org

AI & ML interests

Scaling Data-Constrained Language Models

Recent Activity

craffel  authored a paper about 1 month ago
TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior
thomwolf  authored a paper 3 months ago
Robot Learning: A Tutorial
thomwolf  authored a paper 7 months ago
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
View all activity

Niklas Muennighoff's profile picture Teven Le Scao's profile picture Nouamane Tazi's profile picture Risto Luukkonen's profile picture Aleksandra Piktus's profile picture Sampo Pyysalo's profile picture Colin Raffel's profile picture Thomas Wolf's profile picture Sasha Rush's profile picture

datablations 's datasets 13

datablations/scripts

Viewer • Updated Jun 15, 2023 • 3.48M • 552

datablations/oscar-subsets

Viewer • Updated Jun 14, 2023 • 365k • 220

datablations/c4-subsets

Viewer • Updated Jun 14, 2023 • 729k • 295 • 5

datablations/c4-filter-megatron

Updated May 28, 2023 • 100

datablations/oscar-filter-megatron

Updated May 27, 2023 • 32

datablations/python-megatron

Updated May 22, 2023 • 6.78k • 1

datablations/subsets

Viewer • Updated May 10, 2023 • 365k • 99

datablations/oscar-filter

Viewer • Updated May 10, 2023 • 432M • 610

datablations/oscar-dedup-expanded

Viewer • Updated May 10, 2023 • 432M • 108

datablations/mup

Updated Apr 24, 2023 • 1.14k

datablations/c4-filter

Viewer • Updated Feb 1, 2023 • 365M • 353

datablations/c4-filter-small

Viewer • Updated Jan 17, 2023 • 100k • 10

datablations/oscar-filter-small

Viewer • Updated Nov 24, 2022 • 100k • 1
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs