GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
189
Yaroslav Bulatov
yaroslavvb
·
AI & ML interests
large-scale training, optimization, automatic differentiation
Organizations
None yet
upvoted
a
paper
over 1 year ago