RePaIR: Repaired pruning at initialization resilience

Download PDF
Open Webpage

Haocheng Zhao, Runwei Guan, Ka Lok Man, Limin Yu, Yutao Yue

Published: 01 Jan 2025, Last Modified: 15 May 2025Neural Networks 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•A novel Lipschitz-based initialization algorithm for BatchNorm.•A novel Lipschitz-based weight scaling algorithm for Pruning at Initialization.•An improved SynFlow pruning at initialization algorithm based on Lipschitz.