Spectral and Subspace Dynamics of LoRA in SFT and Reinforcement Learning
A new research paper investigates the singular spectrum and subspaces of LoRA updates, showing how reinforcement learning concentrates updates differently
A new research paper investigates the singular spectrum and subspaces of LoRA updates, showing how reinforcement learning concentrates updates differently