LoRA Training Provably Converges to a Low-Rank Global Minimum or It Fails Loudly (But it Probably Won't Fail)
Abstract
Low-rank adaptation (LoRA) .
Type
Publication
arXiv preprint
Jaeyeon Kim
Ph.D. Student
My research interest spans optimization and science of artificial intelligence.