Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Light

Open Webpage

Ali Hassani, Fengzhe Zhou, Aditya Kane, Jiannan Huang, Chieh-Yun Chen, Min Shi, Steven Walton, Markus Hoehnerbach, Vijay Thakkar, Michael Isaev, Qinsheng Zhang, Bing Xu, Haicheng Wu, Wen-Mei Hwu, Ming-Yu Liu, Humphrey Shi

Published: 2025, Last Modified: 07 May 2026CoRR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0