Sleep Deprivation in the Forward-Forward Algorithm

Mircea Tudor Lică, David Dinucu-Jianu

Keywords: Forward-Forward, neuromorphic

Abstract: This paper aims to explore the separation of the two forward passes in the Forward-Forward algorithm from a biological perspective in the context of sleep. We show the size of the gap between the sleep and awake phase influences the learning capabilities of the algorithm and highlight the importance of negative data in diminishing the devastating effects of sleep deprivation.

Community Implementations: [ 2 code implementations](https://www.catalyzex.com/paper/arxiv:2310.18647/code)