Weakly Semi-supervised Phenotyping Using Electronic Health Records

Elsevier

Available online 5 September 2022, 104175

Journal of Biomedical InformaticsHighlights•

Weakly supervised learning algorithms fail for episodic phenotypes that cannot be consistently detected via ICD and NLP data.

WSS-DL method combines the strengths of deep learning and weakly supervised learning.

WSS-DL retrains high phenotyping performance with only very small numbers of labels.

WSS-DL has the potential in aiding doctors to phenotype rare diseases as well as conditions susceptible to misdiagnosis.

AbstractObjective

Electronic Health Record (EHR) based phenotyping is a crucial yet challenging problem in the biomedical field. Though clinicians typically determine patient-level diagnoses via manual chart review, the sheer volume and heterogeneity of EHR data renders such tasks challenging, time-consuming, and prohibitively expensive, thus leading to a scarcity of clinical annotations in EHRs. Weakly supervised learning algorithms have been successfully applied to various EHR phenotyping problems, due to their ability to leverage information from large quantities of unlabeled samples to better inform predictions based on a far smaller number of patients. However, most weakly supervised methods are subject to the challenge to choose the right cutoff value to generate an optimal classifier. Furthermore, since they only utilize the most informative features (i.e., main ICD and NLP counts) they may fail for episodic phenotypes that cannot be consistently detected via ICD and NLP data. In this paper, we propose a label-efficient, weakly semi-supervised deep learning algorithm for EHR phenotyping (WSS-DL), which overcomes the limitations above.

Materials and Methods

WSS-DL classifies patient-level disease status through a series of learning stages: 1) generating silver standard labels, 2) deriving enhanced-silver-standard labels by fitting a weakly supervised deep learning with silver standard labels as outcomes and high dimensional EHR features as input, and 3) obtaining the final prediction score and classifier by fitting a supervised learning model with a minimal number of gold standard labels as outcome, and the enhanced-silver-standard labels and a minimal set of most informative EHR features as input. To assess generalizability of WSS-DL across different phenotypes and medical institutions, we apply WSS-DL to classify a total of 17 diseases, including both acute and chronic conditions, using EHR data from three healthcare systems. Additionally, we determine the minimum quantity of training labels required by WSS-DL to outperform existing supervised and semi-supervised phenotyping methods.

Results

The proposed method, in combining the strengths of deep learning and weakly semi-supervised learning, successfully leverages the crucial phenotyping information contained in EHR features from unlabeled samples. Indeed, the deep learning model’s ability to handle high-dimensional EHR features allows it to generate strong phenotype status predictions from silver standard labels. These predictions, in turn, provide highly effective features in the final logistic regression stage, leading to high phenotyping accuracy in notably small subsets of labeled data (e.g. n = 40 labeled samples).

Conclusion

Our method’s high performance in EHR datasets with very small numbers of labels indicates its potential value in aiding doctors to phenotype rare diseases as well as conditions susceptible to misdiagnosis.

Keywords

deep learning

EHR phenotyping

label efficient

silver-standard labels

weakly supervised

View full text

© 2022 Published by Elsevier Inc.

留言 (0)

沒有登入
gif