Elementary superexpressive activations

Dmitry Yarotsky

Abstract: We call a finite family of activation functions \emph{superexpressive} if any multivariate continuous function can be approximated by a neural network that uses these activations and has a fixed ar...