Decentralized Plasticity in Reservoir Dynamical Networks for Pervasive Environments

Valerio De Caro, Davide Bacciu, Claudio Gallicchio

Keywords: homeostatic plasticity, intrinsic plasticity, localised learning, echo state networks, reservoir computing, pervasive AI

TL;DR: We use intrinsic plasticity to optimize dynamical neural systems for federated and continual learning in pervasive environments with distributed and dynamic data.

Abstract: We propose a framework for localized learning with Reservoir Computing dynamical neural systems in pervasive environments, where data is distributed and dynamic. We use biologically plausible intrinsic plasticity (IP) learning to optimize the non-linearity of system dynamics based on local objectives, and extend it to account for data uncertainty. We develop two algorithms for federated and continual learning, FedIP and FedCLIP, which respectively extend IP to client-server topologies and to prevent catastrophic forgetting in streaming data scenarios. Results on real-world datasets from human monitoring show that our approach improves performance and robustness, while preserving privacy and efficiency.

Submission Number: 27