NeuroBCI: Multi-Brain to Multi-Robot Interaction Through EEG-Adaptive Neural Networks and Semantic Communications

Jinhui Ouyang, Mingzhu Wu, Xinglin Li, Hanhui Deng, Zhanpeng Jin, Di Wu

Abstract: Recent advancements in EEG-based BCI technologies have been explored to assist individuals in executing brain-to-robot tasks. In the future, using BCI systems in both personal and professional domains is anticipated in widespread adoption. One promising application is facing home life, to enable people to use commercial EEG equipment to implement daily tasks. However, current BCI studies mainly focus on single-brain-to-single-robot interaction, which has limitations in representing diverse human intentions. A generalized BCI system with multiple EEG devices allows users to more precisely or collaboratively control robots. Therefore, it is imperative to extend the BCI techniques to future collaboration scenarios. In this paper, we present a new system, NeuroBCI, for multi-brain-to-multi-robot interaction through the integration of sensing, computing, communication, and control. To improve sensing efficiency, NeuroBCI employs a sparse attention mechanism to extract joint features from heterogeneous EEG data. Parallel computation and transmission for multi-user multi-task scenarios are handled by semantic autoencoder and autodecoder communications. A code map is designed to ensure concurrent control and model compression methods are used on both transmitter and receiver sides. Our experiments in comparison with state-of-the-art works show the superior performance of NeuroBCI on sensing, computing, communication, and control as a holistic system.