Magnitude Attention-based Dynamic Pruning

Open Webpage

Jihye Back, Namhyuk Ahn, Jangho Kim

Published: 01 Jan 2025, Last Modified: 10 Nov 2025Expert Syst. Appl. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•We propose a magnitude attention-based pruning method (Section 4) and validate it against state-of-the-art methods (Section 5.2).•We analyze magnitude attention’s impact and highlight the importance of mask selection in dynamic pruning (Section 5.3.1)•We propose an exploration–exploitation strategy for dynamic pruning (Section 4), achieving superior results over static methods.