DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Reducing Sample Size While Improving Equity in Vaccine Clinical Trials: A Machine Learning-Based Recruitment Methodology with Application to Improving Trials of Hepatitis C Virus Vaccines in People Who Inject Drugs

Journal Article · · Healthcare

Despite the availability of direct-acting antivirals that cure individuals infected with the hepatitis C virus (HCV), developing a vaccine is critically needed in achieving HCV elimination. HCV vaccine trials have been performed in populations with high incidence of new HCV infection such as people who inject drugs (PWID). Developing strategies of optimal recruitment of PWID for HCV vaccine trials could reduce sample size, follow-up costs and disparities in enrollment. We investigate trial recruitment informed by machine learning and evaluate a strategy for HCV vaccine trials termed PREDICTEE—Predictive Recruitment and Enrichment method balancing Demographics and Incidence for Clinical Trial Equity and Efficiency. PREDICTEE utilizes a survival analysis model applied to trial candidates, considering their demographic and injection characteristics to predict the candidate’s probability of HCV infection during the trial. The decision to recruit considers both the candidate’s predicted incidence and demographic characteristics such as age, sex, and race. We evaluated PREDICTEE using in silico methods, in which we first generated a synthetic candidate pool and their respective HCV infection events using HepCEP, a validated agent-based simulation model of HCV transmission among PWID in metropolitan Chicago. We then compared PREDICTEE to conventional recruitment of high-risk PWID who share drugs or injection equipment in terms of sample size and recruitment equity, with the latter measured by participation-to-prevalence ratio (PPR) across age, sex, and race. Comparing conventional recruitment to PREDICTEE found a reduction in sample size from 802 (95%: 642–1010) to 278 (95%: 264–294) with PREDICTEE, while also reducing screening requirements by 30%. Simultaneously, PPR increased from 0.475 (95%: 0.356–0.568) to 0.754 (95%: 0.685–0.834). Even when targeting a dissimilar maximally balanced population in which achieving recruitment equity would be more difficult, PREDICTEE is able to reduce sample size from 802 (95%: 642–1010) to 304 (95%: 288–322) while improving PPR to 0.807 (95%: 0.792–0.821). PREDICTEE presents a promising strategy for HCV clinical trial recruitment, achieving sample size reduction while improving recruitment equity.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
2470019
Journal Information:
Healthcare, Journal Name: Healthcare Journal Issue: 6 Vol. 12; ISSN 2227-9032
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English

References (65)

Evaluating the Yield of Medical Tests journal May 1982
Prevalence of Hepatitis C Virus Infection in US States and the District of Columbia, 2013 to 2016 journal December 2018
Participation of Women and Older Participants in Randomized Clinical Trials of Lipid-Lowering Therapies journal May 2020
Use of Participation to Prevalence Ratio for Evaluating the Representation Status of Women in Oncology Clinical Trials journal March 2022
Strategies to improve diversity, equity, and inclusion in clinical trials journal September 2021
Influence of alcohol use, race, and viral coinfections on spontaneous HCV clearance in a US veteran population journal October 2004
Eradication of hepatitis C infection: The importance of targeting people who inject drugs journal December 2013
Should we treat acute hepatitis C? A decision and cost‐effectiveness analysis journal January 2018
Estimating Prevalence of Hepatitis C Virus Infection in the United States, 2013‐2016 journal November 2018
Blinded sample size reestimation in event‐driven clinical trials: Methods and an application in multiple sclerosis journal January 2019
Adaptive increase in sample size when interim results are promising: A practical guide with examples journal November 2010
On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data journal January 2011
Pitfalls of the concordance index for survival outcomes journal March 2023
Respondent-Driven Sampling and the Recruitment of People with Small Injecting Networks journal August 2011
High-Risk Geographic Mobility Patterns among Young Urban and Suburban Persons who Inject Drugs and their Injection Network Members journal September 2017
The hunt for a vaccine for hepatitis C virus continues journal April 2021
Batch enrollment for an artificial intelligence-guided intervention to lower neurologic events in patients with undiagnosed atrial fibrillation: rationale and design of a digital clinical trial journal September 2021
Evaluation of operational chronic infection endpoints for HCV vaccine trials journal September 2008
Hepatitis C vaccine clinical trials among people who use drugs: potential for participation and involvement in recruitment journal March 2015
Real-time prediction of clinical trial enrollment and event counts: A review journal November 2015
Clinical trials recruitment planning: A proposed framework from the Clinical Trials Transformation Initiative journal March 2018
Demographic representation in clinical trials for cell-based therapy journal March 2021
The role of social networks and geography on risky injection behaviors of young persons who inject drugs journal September 2015
Risk factors for loss to follow-up of persons who inject drugs enrolled at syringe services programs in Kentucky journal September 2021
Hepatitis C Virus Infection in the Older Patient journal December 2017
Participation of Women in Clinical Trials Supporting FDA Approval of Cardiovascular Drugs journal May 2018
Minority Representation in Clinical Trials in the United States journal January 2021
Artificial Intelligence for Clinical Trial Design journal August 2019
Are young injection drug users ready and willing to participate in preventive HCV vaccine trials? journal August 2010
Identification of patients at risk of Clostridioides difficile infection for enrollment in vaccine clinical trials journal January 2021
Towards a predictive model of COVID-19 vaccine hesitancy among American adults journal March 2022
Random Forests journal January 2001
Enrichment of Clinical Study Populations journal October 2010
An explainable machine learning-based phenomapping strategy for adaptive predictive enrichment in randomized clinical trials journal November 2023
Randomized Trial of a Vaccine Regimen to Prevent Chronic HCV Infection journal February 2021
Adaptive enrichment designs for clinical trials journal March 2013
Models of Care for the Management of Hepatitis C Virus Among People Who Inject Drugs: One Size Does Not Fit All journal August 2013
A Qualitative Scoping Review of Early-Terminated Clinical Trials Sponsored by the Department of Veterans Affairs Cooperative Studies Program From 2010 to 2020 journal October 2022
Hepatitis C virus therapy in the direct acting antiviral era journal January 2014
Needle Exchange and Injection-Related Risk Behaviors in Chicago: A Longitudinal Study journal January 2007
Sensitivity Analysis for the Assessment of Causal Vaccine Effects on Viral Load in HIV Vaccine Trials journal August 2003
Loss to follow‐up: A significant barrier in the treatment cascade with direct‐acting therapies journal December 2019
Generalizing Evidence from Randomized Trials Using Inverse Probability of Sampling Weights
  • Buchanan, Ashley L.; Hudgens, Michael G.; Cole, Stephen R.
  • Journal of the Royal Statistical Society Series A: Statistics in Society, Vol. 181, Issue 4 https://doi.org/10.1111/rssa.12357
journal February 2018
Generalizing Trial Evidence to Target Populations in Non-Nested Designs: Applications to AIDS Clinical Trials
  • Li, Fan; Buchanan, Ashley L.; Cole, Stephen R.
  • Journal of the Royal Statistical Society Series C: Applied Statistics, Vol. 71, Issue 3 https://doi.org/10.1111/rssc.12550
journal March 2022
Inverse probability weighting journal January 2016
Higher clearance of hepatitis C virus infection in females compared with males journal September 2005
Factors Associated with Spontaneous Clearance of Hepatitis C Virus among Illicit Drug Users journal January 2007
Women’s Participation in Cardiovascular Clinical Trials From 2010 to 2017 journal February 2020
Adaptive Enrichment Designs for Stroke Clinical Trials journal July 2017
Developing an HIV Behavioral Surveillance System for Injecting Drug Users: The National HIV Behavioral Surveillance System journal January 2007
Unsuccessful trial accrual and human subjects protections: An empirical analysis of recently closed trials journal December 2014
Evaluating biomarkers for prognostic enrichment of clinical trials journal August 2017
Hepatitis C treatment access and uptake for people who inject drugs: a review mapping the role of social factors journal January 2013
Patient recruitment strategies for adaptive enrichment designs with time-to-event endpoints journal July 2019
Blinded sample size re-estimation in a comparative diagnostic accuracy study journal April 2022
A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results journal November 2015
Implementation of a batched stepped wedge trial evaluating a quality improvement intervention for surgical teams to reduce anastomotic leak after right colectomy journal May 2023
Random survival forests journal September 2008
Female Sex and IL28B, a Synergism for Spontaneous Viral Clearance in Hepatitis C Virus (HCV) Seroconverters from a Community-Based Cohort journal November 2011
Trends in the Population Prevalence of People Who Inject Drugs in US Metropolitan Areas 1992–2007 journal June 2013
Agent-Based Model Forecasts Aging of the Population of People Who Inject Drugs in Metropolitan Chicago and Changing Prevalence of Hepatitis C Infections journal September 2015
Modeling hepatitis C micro-elimination among people who inject drugs with direct-acting antivirals in metropolitan Chicago journal March 2022
Random Forests for Genetic Association Studies journal January 2011
Race and Ethnicity Representation in Clinical Trials: Findings from a Literature Review of Phase I Oncology Trials journal May 2021
Equation-Based Modeling vs. Agent-Based Modeling with Applications to the Spread of COVID-19 Outbreak journal January 2023