On the ideal number of groups for isometric gradient propagation

Open Webpage

Bum Jun Kim, Hyeyeon Choi, Hyeonah Jang, Sang Woo Kim

Published: 01 Jan 2024, Last Modified: 28 Sept 2024Neurocomputing 2024EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•We propose a method to determine the number of groups of group normalization.•A theoretical analysis of group normalization with activation function is provided.•The proposed method is validated against various practical problems.