Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models

Open Webpage

Laura Ruis, Maximilian Mozes, Juhan Bae, Siddhartha Rao Kamalakara, Dwaraknath Gnaneshwar, Acyr Locatelli, Robert Kirk, Tim Rocktäschel, Edward Grefenstette, Max Bartolo

Published: 01 Jan 2025, Last Modified: 15 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0