The Empirical Impact of Reducing Symmetries on the Performance of Deep Ensembles and MoE

Andrei Chernov, Oleg Novitskij

Published: 05 Mar 2025, Last Modified: 05 Mar 2025ICLR 2025 Workshop Weight Space Learning PosterEveryoneRevisionsBibTeXCC BY 4.0
Track: long paper (up to 8 pages)
Keywords: Asymmetric networks, neural networks, ensembles, Mixture of Experts, Deep Ensemble
TL;DR: We showed that reducing symmetries can lead to increased performance of neural network ensembles
Submission Number: 46

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview