DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Budget constrained machine learning for early prediction of adverse outcomes for COVID-19 patients

Journal Article · · Scientific Reports

Abstract The combination of machine learning (ML) and electronic health records (EHR) data may be able to improve outcomes of hospitalized COVID-19 patients through improved risk stratification and patient outcome prediction. However, in resource constrained environments the clinical utility of such data-driven predictive tools may be limited by the cost or unavailability of certain laboratory tests. We leveraged EHR data to develop an ML-based tool for predicting adverse outcomes that optimizes clinical utility under a given cost structure. We further gained insights into the decision-making process of the ML models through an explainable AI tool. This cohort study was performed using deidentified EHR data from COVID-19 patients from ProMedica Health System in northwest Ohio and southeastern Michigan. We tested the performance of various ML approaches for predicting either increasing ventilatory support or mortality. We performed post hoc analysis to obtain optimal feature sets under various budget constraints. We demonstrate that it is possible to achieve a significant reduction in cost at the expense of a small reduction in predictive performance. For example, when predicting ventilation, it is possible to achieve a 43% reduction in cost with only a 3% reduction in performance. Similarly, when predicting mortality, it is possible to achieve a 50% reduction in cost with only a 1% reduction in performance. This study presents a quick, accurate, and cost-effective method to evaluate risk of deterioration for patients with SARS-CoV-2 infection at the time of clinical evaluation.

Sponsoring Organization:
USDOE
OSTI ID:
1823289
Journal Information:
Scientific Reports, Journal Name: Scientific Reports Journal Issue: 1 Vol. 11; ISSN 2045-2322
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (44)

Association of Intensive Care Unit Patient Load and Demand With Mortality Rates in US Department of Veterans Affairs Hospitals During the COVID-19 Pandemic journal January 2021
Interpretability of machine learning‐based prediction models in healthcare journal June 2020
Gaussian Processes in Machine Learning book January 2004
Causal influences of neuroticism on mental health and cardiovascular disease journal May 2021
Clinical features of COVID-19 mortality: development and validation of a clinical prediction model journal October 2020
Procalcitonin in patients with severe coronavirus disease 2019 (COVID-19): A meta-analysis journal June 2020
Kidney diseases and COVID-19 infection: causes and effect, supportive therapeutics and nutritional perspectives journal January 2021
Procalcitonin levels in COVID-19 patients journal August 2020
Diagnostic performance of initial blood urea nitrogen combined with D-dimer levels for predicting in-hospital mortality in COVID-19 patients journal September 2020
Feature selection with test cost constraint journal January 2014
Personalized predictive models for symptomatic COVID-19 patients using basic preconditions: Hospitalizations, mortality, and the need for an ICU or ventilator journal October 2020
A Closer Look Into Global Hospital Beds Capacity and Resource Shortages During the COVID-19 Pandemic journal April 2021
Gaussian process classification for prediction of in-hospital mortality among preterm infants journal July 2018
Correction: Differential transcriptional response following glucocorticoid activation in cultured blood immune cells: a novel approach to PTSD biomarker development journal January 2020
Machine learning based early warning system enables accurate mortality risk prediction for COVID-19 journal October 2020
A novel severity score to predict inpatient mortality in COVID-19 patients journal October 2020
An interpretable mortality prediction model for COVID-19 patients journal May 2020
First Case of 2019 Novel Coronavirus in the United States journal March 2020
Definitions, methods, and applications in interpretable machine learning journal October 2019
Secure and Robust Machine Learning for Healthcare: A Survey journal January 2021
Gaussian Processes for Personalized e-Health Monitoring With Wearable Sensors journal January 2013
Genetic evidence suggests posttraumatic stress disorder as a subtype of major depressive disorder journal April 2021
Early predictors for mechanical ventilation in COVID-19 patients journal January 2020
Cost-Constrained feature selection in binary classification: adaptations for greedy forward selection and genetic algorithms journal January 2020
Genetic Support of A Causal Relationship Between Iron Status and Type 2 Diabetes: A Mendelian Randomization Study journal June 2021
Sex-Specific Association of Circulating Ferritin Level and Risk of Type 2 Diabetes: A Dose-Response Meta-Analysis of Prospective Studies journal May 2019
Logistic Regression in Medical Research journal January 2021
Strategies for Handling Missing Data in Electronic Health Record Derived Data journal December 2013
Kidney function on admission predicts in-hospital mortality in COVID-19 journal September 2020
Association between procalcitonin levels and duration of mechanical ventilation in COVID-19 patients journal September 2020
COVID-19 mortality risk assessment: An international multi-center study journal December 2020
Body Mass Index and Risk for COVID-19–Related Hospitalization, Intensive Care Unit Admission, Invasive Mechanical Ventilation, and Death — United States, March–December 2020 journal March 2021
COVID-19–Associated Acute Kidney Injury: Learning from the First Wave journal October 2020
COVID-19 and AKI: Where Do We Stand? journal February 2021
Co-expression network analysis identified hub genes critical to triglyceride and free fatty acid metabolism as key regulators of age-related vascular dysfunction in mice journal September 2019
Genetic regulatory subnetworks and key regulating genes in rat hippocampus perturbed by prenatal malnutrition: implications for major brain disorders journal May 2020
Estimated glomerular filtration rate, anemia and outcomes in patients with ischemic stroke journal January 2020
Developing prediction models for clinical use using logistic regression: an overview journal March 2019
Prognostic Modeling of COVID-19 Using Artificial Intelligence in the United Kingdom: Model Development and Validation journal January 2020
Improving Diagnosis of Depression With XGBOOST Machine Learning Model and a Large Biomarkers Dutch Dataset (n = 11,081) journal April 2020
Immunodeficiency Promotes Adaptive Alterations of Host Gut Microbiome: An Observational Metagenomic Study in Mice journal November 2019
A Machine-Learning-Based Prediction Method for Hypertension Outcomes Based on Medical Data journal November 2019
Age-Related Morbidity and Mortality among Patients with COVID-19 journal January 2020
Complete blood count might help to identify subjects with high probability of testing positive to SARS-CoV-2 journal July 2020