Window Attention is Bugged: How not to Interpolate Position Embeddings

Open Webpage

Daniel Bolya, Chaitanya Ryali, Judy Hoffman, Christoph Feichtenhofer

Published: 01 Jan 2024, Last Modified: 13 Nov 2024ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0