SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
Paper
•
2312.07987
•
Published
•
41
LLM
-
-
SubGen: Token Generation in Sublinear Time and Memory
Paper • 2402.06082 • Published • 12 -
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 50 -
SaulLM-7B: A pioneering Large Language Model for Law
Paper • 2403.03883 • Published • 90 -
Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning
Paper • 2405.17258 • Published • 17