Eigenvalues of the Hessian in Deep Learning: Symmetry Breaking
An analysis of Hessian spectra in deep learning models links clustered eigenvalues to departures from a hidden symmetric reference state.
An analysis of Hessian spectra in deep learning models links clustered eigenvalues to departures from a hidden symmetric reference state.