LoRA Training Provably Converges to a Low-Rank Global Minimum or It Fails Loudly (But it Probably Won't Fail)

Junsu Kim, Jaeyeon Kim, Ernest K. Ryu
February, 2025
PDF
Type
Preprint
Publication
arXiv preprint
Source Themes
Jaeyeon Kim
Jaeyeon Kim
Ph.D. Student

My research interest spans optimization and science of artificial intelligence.