INTEGRATION OF THE BRAIN-COMPUTER INTERFACE AND 3D- EXTENDED REALITY

Andres Martinez, Raul Rivera, Martin Ferguson-Pell

Keywords: BCI, 3D, VR, XR, rehabilitation, fNIRS, EEG

TL;DR: 3D extend reality integrate with brain-computer interface

Abstract:

Locked-in syndrome patients will communicate in a virtual scenario. We have employed two
neurophysiological techniques (electroencephalography (EEG) and metabolic activity using
functional near-infrared spectroscopy (fNIRS) to control a 3D avatar. Our goal was to compare
the feasibility, usability, and user experience between EEG-BCI and fNIRS-BCI systems to
control VR-simulation in real time. 15 healthy participants attend both sessions and respond to
the Short Version of the User Experience Questionnaire (UEQ-S). Our preliminary results show
the feasibility, usability, and high engagement of this proof-of-concept. This low-cutting-edge
technology communicates and restores features in telerehabilitation and promotes equity with
rural regions.

Submission Number: 46