Towards the Efficient Inference by Incorporating Automated Computational Phenotypes under Covariate Shift
Abstract: Collecting gold-standard phenotype data via manual extraction is typically labor-intensive and slow, whereas automated computational phenotypes (ACPs) offer a systematic and much faster alternative.
However, simply replacing the gold-standard with ACPs, without acknowledging their differences, could lead to biased results and misleading conclusions.
Motivated by the complexity of incorporating ACPs while maintaining the validity of downstream analyses, in this paper, we consider a semi-supervised learning setting that consists of both labeled data (with gold-standard) and unlabeled data (without gold-standard), under the covariate shift framework.
We develop doubly robust and semiparametrically efficient estimators that leverage ACPs for general target parameters in the unlabeled and combined populations. In addition,
we carefully analyze the efficiency gains achieved by incorporating ACPs, comparing scenarios with and without their inclusion.
Notably, we identify that ACPs for the unlabeled data, instead of for the labeled data, drive the enhanced efficiency gains. To validate our theoretical findings, we conduct comprehensive synthetic experiments and apply our method to multiple real-world datasets, confirming the practical advantages of our approach.
Lay Summary: In this paper, we explore the benefits of incorporating automated computational phenotypes (ACPs) in a semi-supervised learning framework under covariate shift, particularly in terms of improving estimation efficiency.
We propose an estimator that is both doubly robust and semiparametrically efficient.
Additionally, our method allows for a rigorous quantification of the efficiency gain through closed-form expressions.
Link To Code: https://github.com/brucejunjin/ICML2025-ACPCS
Primary Area: General Machine Learning->Unsupervised and Semi-supervised Learning
Keywords: semi-supervised learning, covariate shift, automated computational phenotype, efficiency gain
Submission Number: 7376
Loading