Collection by
Feb 20
Feb 20Collections
Discover the best community collections!
Collections including paper arxiv:2304.01373
Collection by
Apr 17
Apr 17-
Training Compute-Optimal Large Language Models
Paper • 2203.15556 • Published • 11 -
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Paper • 1909.08053 • Published • 2 -
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Paper • 1910.10683 • Published • 14 -
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 9
Collection by
Dec 29, 2023
Dec 29, 2023-
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 9 -
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper • 2307.09288 • Published • 243 -
Mistral 7B
Paper • 2310.06825 • Published • 51 -
microsoft/phi-2
Text Generation • 3B • Updated • 855k • 3.38k
Collection by
Jul 1
Jul 1
Collection by
May 30, 2024
May 30, 2024-
MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series
Paper • 2405.19327 • Published • 49 -
LLM360/K2
Text Generation • 65B • Updated • 277 • 89 -
OLMo: Accelerating the Science of Language Models
Paper • 2402.00838 • Published • 84 -
LLM360: Towards Fully Transparent Open-Source LLMs
Paper • 2312.06550 • Published • 57
Collection by
Apr 13, 2024
Apr 13, 2024-
Simple linear attention language models balance the recall-throughput tradeoff
Paper • 2402.18668 • Published • 21 -
Linear Transformers with Learnable Kernel Functions are Better In-Context Models
Paper • 2402.10644 • Published • 82 -
Repeat After Me: Transformers are Better than State Space Models at Copying
Paper • 2402.01032 • Published • 25 -
Zoology: Measuring and Improving Recall in Efficient Language Models
Paper • 2312.04927 • Published • 2
Collection by
Aug 1, 2024
Aug 1, 2024-
Attention Is All You Need
Paper • 1706.03762 • Published • 77 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 19 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 9 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 17
Collection by
Feb 26
Feb 26Collection by
Feb 20
Feb 20Collection by
May 30, 2024
May 30, 2024-
MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series
Paper • 2405.19327 • Published • 49 -
LLM360/K2
Text Generation • 65B • Updated • 277 • 89 -
OLMo: Accelerating the Science of Language Models
Paper • 2402.00838 • Published • 84 -
LLM360: Towards Fully Transparent Open-Source LLMs
Paper • 2312.06550 • Published • 57
Collection by
Apr 17
Apr 17-
Training Compute-Optimal Large Language Models
Paper • 2203.15556 • Published • 11 -
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Paper • 1909.08053 • Published • 2 -
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Paper • 1910.10683 • Published • 14 -
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 9
Collection by
Apr 13, 2024
Apr 13, 2024-
Simple linear attention language models balance the recall-throughput tradeoff
Paper • 2402.18668 • Published • 21 -
Linear Transformers with Learnable Kernel Functions are Better In-Context Models
Paper • 2402.10644 • Published • 82 -
Repeat After Me: Transformers are Better than State Space Models at Copying
Paper • 2402.01032 • Published • 25 -
Zoology: Measuring and Improving Recall in Efficient Language Models
Paper • 2312.04927 • Published • 2
Collection by
Dec 29, 2023
Dec 29, 2023-
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 9 -
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper • 2307.09288 • Published • 243 -
Mistral 7B
Paper • 2310.06825 • Published • 51 -
microsoft/phi-2
Text Generation • 3B • Updated • 855k • 3.38k
Collection by
Aug 1, 2024
Aug 1, 2024-
Attention Is All You Need
Paper • 1706.03762 • Published • 77 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 19 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 9 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 17
Collection by
Jul 1
Jul 1Collection by
Feb 26
Feb 26