Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability

Open Webpage

Ivan Lee, Nan Jiang, Taylor Berg-Kirkpatrick

Published: 01 Jan 2024, Last Modified: 30 Sept 2024ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0