Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper
•
2403.07816
•
Published
•
44
Treasure
-
-
microsoft/phi-1_5
Text Generation • 1B • Updated • 46.3k • 1.35k -
Language models scale reliably with over-training and on downstream tasks
Paper • 2403.08540 • Published • 15 -
Akashpb13/Swahili_xlsr
Automatic Speech Recognition • 0.3B • Updated • 36 • 8 -
EleutherAI/pythia-70m
95.6M • Updated • 136k • 76 -
LLM Agent Operating System
Paper • 2403.16971 • Published • 72 -
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper • 2404.14219 • Published • 259