Designing Neural Network CollectivesDownload PDF

Published: 21 Apr 2022, Last Modified: 05 May 2023Cells2Societies 2022 PosterReaders: Everyone
Keywords: Ideas Track, collective intelligence, deep learning, neural network collectives
TL;DR: We propose that methods of collective intelligence can be applied to design and optimise collections of artificial neural networks , so-called neural network collectives, for novel emergent learning structures
Abstract: Artificial neural networks have demonstrated exemplary learning capabilities in a wide range of tasks, including computer vision, natural language processing and, most recently, graph-based learning. Many of the advances in deep learning have been made possible by the large design-space for neural network architectures. We believe that this diversity in architectures may lead to novel and emergent learning capabilities, especially when architectures are connected into a collective system. In this work, we outline a form of neural network collectives (NNC), motivated by recent work in the field of collective intelligence, and give details about the specific sub-components that an NNC may have.
0 Replies