Deep Ridgelet Transform: Voice with Koopman Operator Constructively Proves Universality of Formal Deep Networks

Published: 29 Nov 2023, Last Modified: 29 Nov 2023NeurReps 2023 PosterEveryoneRevisionsBibTeX
Submission Track: Proceedings
Keywords: deep neural network, group representation, Koopman operator, Schur's lemma, voice transform
Abstract: We identify hidden layers inside a deep neural network (DNN) with group actions on the data domain, and formulate a formal deep network as a dual voice transform with respect to the Koopman operator, a linear representation of the group action. Based on the group theoretic arguments, particularly by using Schur's lemma, we show a simple proof of the universality of DNNs.
Submission Number: 27