PhyFF: Physical forward forward algorithm for in-hardware training and inference

Ali Momeni, Babak Rahmani, Matthieu Malléjac, Philipp del Hougne, Romain Fleury

Keywords: Physical neural networks (PNNs), Optical neural networks (ONNs), PNNs Training

TL;DR: This paper discusses the direct training of deep physical neural networks, which consist of layers of various physical nonlinear systems, without requiring complete knowledge of the underlying physics.

Abstract: Training of digital deep learning models primarily relies on backpropagation, which poses challenges for physical implementation due to its dependency on precise knowledge of computations performed in the forward pass of the neural network. To address this issue, we propose a physical forward forward training algorithm (phyFF) that is inspired by the original forward forward algorithm. This novel approach facilitates direct training of deep physical neural networks comprising layers of diverse physical nonlinear systems, without the need for the complete knowledge of the underlying physics. We demonstrate the superiority of this method over current hardware-aware training techniques. The proposed method achieves faster training speeds, reduces digital computational requirements, and lowers training's power consumption in physical systems.

Submission Number: 22