Augmentation Strategies for Self-Supervised Representation Learning from Electrocardiograms

Matilda Andersson, Mattias Nilsson, Gabrielle Flood, Kalle Åström

Abstract: In this paper, we investigate the effects of different augmentation strategies in self-supervised representation learning from electrocardiograms. Our study examines the impact of ran-dom resized crop and time out on downstream performance. We also consider the importance of the signal length. Furthermore, instead of using two augmented copies of the sample as a positive pair, we suggest augmenting only one. The second signal is kept as the original signal. These different augmentation strategies are investigated in the context of pre-training and fine-tuning, fol-lowing the different self-supervised learning frameworks BYOL, SimCLR, and VICReg. We formulate the downstream task as a multi-label classification task using a public dataset containing ECG recordings and annotations. In our experiments, we demon-strate that self-supervised learning can consistently outperform classical supervised learning when configured correctly. These findings are of particular importance in the medical domain, as the medical labeling process is particularly expensive, and clinical ground truth is often difficult to define. We are hopeful that our findings will be a catalyst for further research into augmentation strategies in self-supervised learning to improve performance in the detection of cardiovascular disease.