Time-Series Foundation Model Embeddings as Means for Physiological Feature Extraction

Yujin Lee, Fanurs C.E. Teh, Joo Heung Yoon, Artur Dubrawski

Presentation Attendance: Yes, we will present in-person

Keywords: Time-Series Foundation Models, Physiological Time-Series, Medical Signal Processing, Representation Learning

Abstract:

Physiological time-series, such as electrocardiograms, photoplethysmograms, or respiratory waveforms, are widely used for clinical assessment, prognosis, and monitoring. Recently, time-series foundation models (TSFMs) have demonstrated strong performance across various downstream tasks in the medical domain. However, it remains unclear whether TSFM embeddings include physiologically meaningful information. In this study, we systematically examine physiological features to evaluate whether TSFM embeddings provide a significant representation premium over raw signals by mapping temporal data into a more learnable representation space.
We demonstrate this by training regressors to predict clinically informative diagnostic features. Addressing the limitation that TSFM embeddings lack amplitude information due to normalization, we propose re-injecting global scale statistics to the embeddings. Experimental results show that embedding-based feature extraction achieves on average 17.90% improvement in relative RMSE compared to raw signal-based extraction, with particularly strong gains in real-world noisy datasets. Specifically, periodicity-based features exhibited a substantial average performance improvement of 26.02%, while amplitude-based features showed an increase of 18.28%. In comparison, morphology-based features showed comparatively limited improvements, achieving gains of 11.82% from raw signals and 2.60% from second-derivative signals.

Track: Research Track (max 4 pages)

Submission Number: 35