Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking

Open Webpage

Kaifeng Lyu, Jikai Jin, Zhiyuan Li, Simon Shaolei Du, Jason D. Lee, Wei Hu

Published: 01 Jan 2024, Last Modified: 08 Oct 2024ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0