Learning Interactions in Complex Biological Systems
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
In this project, we developed novel methods for integrating simulation and data-driven methods to accelerate biomedical discovery. In particular, we exploit agent-based models of disease processes and deep reinforcement learning to identify potential novel multi-drug, patient-specific, and adaptive therapeutic strategies. We use the Innate Immune Response agent-based model (IIRABM) to model sepsis as a demonstration of our approach. We first calibrate the agent-based model using novel stochastic optimization algorithms develop in this project, then use the calibrated model to identify optimal cytokine mediation strategies using deep reinforcement learning (DRL). The learned policy achieves a dramatic reduction in mortality over a set of 500 simulated patients relative to standalone antibiotic therapy. Advantages of our approach are three-fold: 1) the use of simulation allows exploring therapeutic strategies beyond clinical practice and available data, 2) advances in DRL accommodate learning complex therapeutic strategies for complex biological systems, and 3) optimized treatments respond to a patient’s individual disease progression over time, therefore capturing both differences across patients and the inherent randomness of disease progression within a single patient. We hope that this work motivates both considering adaptive, personalized multi-cytokine mediation therapy for sepsis and exploiting simulation with DRL for precision medicine more broadly.
- Research Organization:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program
- DOE Contract Number:
- AC52-07NA27344; 17-ERD-036
- OSTI ID:
- 1573143
- Report Number(s):
- LLNL-TR-795957; 997122
- Country of Publication:
- United States
- Language:
- English
Similar Records
Examining the controllability of sepsis using genetic algorithms on an agent-based model of systemic inflammation
Sepsis reconsidered: Identifying novel metrics for behavioral landscape characterization with a high-performance computing implementation of an agent-based model