Statistical Vignettes on the Grokking Phenomenon
Researchers study grokking in a simple, analytically tractable setting to disentangle initialization, signal strength, weight decay, and sample size effect
Researchers study grokking in a simple, analytically tractable setting to disentangle initialization, signal strength, weight decay, and sample size effect