Stabilizing High-Dimensional Prediction Models Using Feature Graphs

Shivapratap Gopakumar, Truyen Tran, Tu Dinh Nguyen, Dinh Q. Phung, Svetha Venkatesh

Abstract: We investigate feature stability in the context of clinical prognosis derived from high-dimensional electronic medical records. To reduce variance in the selected features that are predictive, we introduce Laplacian-based regularization into a regression model. The Laplacian is derived on a feature graph that captures both the temporal and hierarchic relations between hospital events, diseases, and interventions. Using a cohort of patients with heart failure, we demonstrate better feature stability and goodness-of-fit through feature graph stabilization.