Decentralized SGD under Heavy-Tailed Noise: Optimal Convergence Rates and Gradient Clipping
This paper analyzes the impact of gradient clipping and normalization on decentralized non-convex optimization under heavy-tailed noise.
This paper analyzes the impact of gradient clipping and normalization on decentralized non-convex optimization under heavy-tailed noise.