Position: Do pretrained Transformers Learn In-Context by Gradient Descent?

Open Webpage

Lingfeng Shen, Aayush Mishra, Daniel Khashabi

Published: 01 Jan 2024, Last Modified: 27 Sept 2024ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0