Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model

Open Webpage

Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka

Published: 2024, Last Modified: 29 Jul 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0