Temporally Rich Deep Learning Models for Magnetoencephalography

Published: 30 Jan 2024, Last Modified: 30 Jan 2024Accepted by TMLREveryoneRevisionsBibTeX
Abstract: Deep learning has been used in a wide range of applications, but it has only very recently been applied to Magnetoencephalography (MEG). MEG is a neurophysiological technique used to investigate a variety of cognitive processes such as language and learning, and an emerging technology in the quest to identify neural correlates of cognitive impairments such as those occurring in dementia. Recent work has shown that it is possible to apply deep learning to MEG to categorise induced responses to stimuli across subjects. While novel in the application of deep learning, such work has generally used relatively simple neural network (NN) models compared to those being used in domains such as computer vision and natural language processing. In these other domains, there is a long history in developing complex NN models that combine spatial and temporal information. We propose more complex NN models that focus on modelling temporal relationships in the data, and apply them to the challenges of MEG data. We apply these models to an extended range of MEG-based tasks, and find that they substantially outperform existing work on a range of tasks, particularly but not exclusively temporally-oriented ones. We also show that an autoencoder-based preprocessing component that focuses on the temporal aspect of the data can improve the performance of existing models. Our source code is available at https://github.com/tim-chard/DeepLearningForMEG.
Submission Length: Long submission (more than 12 pages of main content)
Changes Since Last Submission: Camera ready version. Reduced width of figures.
Code: https://github.com/tim-chard/DeepLearningForMEG
Assigned Action Editor: ~Ole_Winther1
License: Creative Commons Attribution 4.0 International (CC BY 4.0)
Submission Number: 1500