MeqMuon: Matrix-Equilibrating Muon for LLM Pretraining
Researchers introduce MeqMuon, incorporating matrix equilibration into the Muon optimizer to improve update magnitude balancing during large language model
Researchers introduce MeqMuon, incorporating matrix equilibration into the Muon optimizer to improve update magnitude balancing during large language model