Generalisation to unseen topologies: Towards control of biological neural network activity

Laurens Engwegen, Daan Brinks, Wendelin Boehmer

Keywords: Reinforcement learning, multitask learning, generalisation, neuroscience, neuronal simulation, closed-loop neuronal control

TL;DR: Introduction of environment with procedurally generated networks of biological neurons, and investigation of generalisation capabilities of RL agents with different architectures to unobserved topologies thereof.

Abstract: Novel imaging and neurostimulation techniques open doors for advancements in closed-loop control of activity in biological neural networks. This would allow for applications in the investigation of activity propagation, and for diagnosis and treatment of pathological behaviour. Due to the partially observable characteristics of activity propagation, through networks in which edges can not be observed, and the dynamic nature of neuronal systems, there is a need for adaptive, generalisable control. In this paper, we introduce an environment that procedurally generates neuronal networks with different topologies to investigate this generalisation problem. Additionally, an existing transformer-based architecture is adjusted to evaluate the generalisation performance of a deep RL agent in the presented partially observable environment. The agent demonstrates the capability to generalise control from a limited number of training networks to unseen test networks.

Submission Number: 92