Coupled Ensembles of Neural Networks

Anuvabh Dutt, Denis Pellerin, Georges Qu\'enot

Feb 12, 2018 (modified: Feb 15, 2018) ICLR 2018 Workshop Submission readers: everyone Show Bibtex
  • Abstract: We present coupled ensembles of neural networks, which is a reconfiguration of existing neural network models into parallel branches. We empirically show that this modification leads to results on CIFAR and SVHN that are competitive to state of the art, with a greatly reduced parameter count. Additionally, for a fixed parameter, or a training time budget coupled ensembles are significantly better than single branch models. Preliminary results on ImageNet are also promising.
  • TL;DR: We show that splitting a neural network into parallel branches improves performance for a parameter budget.
  • Keywords: neural networks, ensemble learning