common-pile/arxiv_abstracts_filtered
Viewer
•
Updated
•
2.5M
•
77
•
1
Common Pile v0.1 Filtered Data
An LLM pre-training dataset produced by filtering and deduplicating the raw text collected in the Common Pile v0.1
-
-
common-pile/arxiv_papers_filtered
Viewer • Updated • 309k • 69 -
common-pile/biodiversity_heritage_library_filtered
Viewer • Updated • 16.5M • 182 -
common-pile/caselaw_access_project_filtered
Viewer • Updated • 5.5M • 90 • 1 -
common-pile/cccc_filtered
Viewer • Updated • 10.8M • 123 • 1 -
common-pile/data_provenance_initiative_filtered
Viewer • Updated • 3.51M • 63 -
common-pile/doab_filtered
Viewer • Updated • 404k • 63 • 1 -
common-pile/foodista_filtered
Preview • Updated • 66 • 1 -
common-pile/github_archive_filtered
Viewer • Updated • 23.3M • 71 -
common-pile/library_of_congress_filtered
Viewer • Updated • 128k • 69 • 2 -
common-pile/libretexts_filtered
Viewer • Updated • 40k • 64 -
common-pile/news_filtered
Viewer • Updated • 127k • 92 • 1 -
common-pile/oercommons_filtered
Viewer • Updated • 5.25k • 61 • 1 -
common-pile/peS2o_filtered
Viewer • Updated • 6.09M • 166 -
common-pile/pre_1929_books_filtered
Viewer • Updated • 122k • 106 -
common-pile/pressbooks_filtered
Viewer • Updated • 54.5k • 64 -
common-pile/project_gutenberg_filtered
Viewer • Updated • 57.1k • 91 -
common-pile/public_domain_review_filtered
Viewer • Updated • 1.41k • 61 -
common-pile/pubmed_filtered
Viewer • Updated • 4.77M • 110 • 2 -
common-pile/python_enhancement_proposals_filtered
Viewer • Updated • 655 • 64 • 1 -
common-pile/regulations_filtered
Viewer • Updated • 192k • 63 -
common-pile/stackexchange_filtered
Viewer • Updated • 27.5M • 238 • 2 -
common-pile/stackv2_edu_filtered
Viewer • Updated • 57M • 331 • 1 -
common-pile/stackv2_html_filtered
Viewer • Updated • 1.67M • 100 -
common-pile/ubuntu_irc_filtered
Viewer • Updated • 216k • 90 -
common-pile/uk_hansard_filtered
Viewer • Updated • 47.9k • 108 • 1 -
common-pile/usgpo_filtered
Viewer • Updated • 2.34M • 103 -
common-pile/uspto_filtered
Viewer • Updated • 14.4M • 682 -
common-pile/wikimedia_filtered
Viewer • Updated • 12.9M • 125 • 2 -
common-pile/wikiteam_filtered
Viewer • Updated • 10.2M • 113 -
common-pile/youtube_filtered
Viewer • Updated • 986k • 112 • 3