Evolutionary-Neural Hybrid Agents for Architecture Search

Krzysztof Maziarz, Andrey Khorlin, Quentin de Laroussilhe, Andrea Gesmundo

Sep 27, 2018 ICLR 2019 Conference Blind Submission readers: everyone Show Bibtex
  • Abstract: Neural Architecture Search has recently shown potential to automate the design of Neural Networks. The use of Neural Network agents trained with Reinforcement Learning can offer the possibility to learn complex patterns, as well as the ability to explore a vast and compositional search space. On the other hand, evolutionary algorithms offer the greediness and sample efficiency needed for such an application, as each sample requires a considerable amount of resources. We propose a class of Evolutionary-Neural hybrid agents (Evo-NAS), that retain the best qualities of the two approaches. We show that the Evo-NAS agent can outperform both Neural and Evolutionary agents, both on a synthetic task, and on architecture search for a suite of text classification datasets.
  • Keywords: Evolutionary, Architecture Search, NAS
  • TL;DR: We propose a class of Evolutionary-Neural hybrid agents, that retain the best qualities of the two approaches.
0 Replies

Loading