Garbage Attention in Large Language Models: BOS Sink Heads and Sink-aware Pruning

Open Webpage

Jaewon Sok, Je Won Yeom, Seonghyeon Park, Jeongjae Park, Taesup Kim

Published: 2026, Last Modified: 28 May 2026CoRR 2026EveryoneRevisionsBibTeXCC BY-SA 4.0