skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Applicability Analysis of Validation Evidence for Biomedical Computational Models

Journal Article · · Journal of Verification, Validation and Uncertainty Quantification
DOI:https://doi.org/10.1115/1.4037671· OSTI ID:1399491
 [1];  [2];  [3];  [2]
  1. Food and Drug Administration (FDA), Silver Spring, MD (United States). Office of Science and Engineering Laboratories (OSEL). Center for Devices and Radiological Health (CDRH)
  2. Food and Drug Administration (FDA), Silver Spring, MD (United States). Office of Science and Engineering Laboratories (OSEL). Center for Devices and Radiological Health (CDRH)
  3. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibility of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.

Research Organization:
Food and Drug Administration (FDA), Silver Spring, MD (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE; Food and Drug Administration (FDA) (United States)
Grant/Contract Number:
AC04-94AL85000
OSTI ID:
1399491
Report Number(s):
SAND2017-2092J; 651131
Journal Information:
Journal of Verification, Validation and Uncertainty Quantification, Vol. 2, Issue 2; ISSN 2377-2158
Publisher:
ASMECopyright Statement
Country of Publication:
United States
Language:
English

References (17)

In silico clinical trials: how computer simulation will transform the biomedical industry journal May 2016
Incorporation of stochastic engineering models as prior information in Bayesian medical device trials journal March 2017
Computational Medicine: Translating Models to Clinical Care journal October 2012
Computational systems biology journal November 2002
Predictive Medicine: Computational Techniques in Therapeutic Decision-Making journal January 1999
Ensuring reliability of safety-critical clinical applications of computational cardiac models journal January 2013
Defining predictive maturity for validated numerical simulations journal April 2010
Risk-based verification, validation, and accreditation process conference April 2010
Verification, validation, and predictive capability in computational engineering and physics journal September 2004
Sandia Verification and Validation Challenge Problem: A PCMM-Based Approach to Assessing Prediction Credibility journal February 2016
Calibration, validation, and sensitivity analysis: What's what journal October 2006
Bayesian calibration of computer models journal August 2001
Type X and Y Errors and Data & amp; Model Conditioning for Systematic Uncertainty in Model Calibration, Validation, and Extrapolation conference April 2008
Design considerations for studies of the biomechanical environment of the femoropopliteal arteries journal September 2013
Effects of Cyclic Loading on the Uniaxial Behavior of Nitinol journal December 2010
Incorporation of stochastic engineering models as prior information in Bayesian medical device trials text January 2017
in silico Clinical Trials: How Computer Simulation will Transform the Biomedical Industry text January 2016

Cited By (11)

Off‐axis loads cause failure of the distal radius at lower magnitudes than axial loads: A side‐to‐side experimental study journal January 2020
Patient-Specific Cardiovascular Computational Modeling: Diversity of Personalization and Challenges journal March 2018
Study on the Accuracy of Structural and FSI Heart Valves Simulations journal August 2018
Advancing Regulatory Science With Computational Modeling for Medical Devices at the FDA's Office of Science and Engineering Laboratories journal September 2018
Validation and Trustworthiness of Multiscale Models of Cardiac Electrophysiology journal February 2018
Functionalized Anatomical Models for Computational Life Sciences journal November 2018
Credibility Evidence for Computational Patient Models Used in the Development of Physiological Closed-Loop Controlled Devices for Critical Care Medicine journal March 2019
Comprehensive Uncertainty Quantification and Sensitivity Analysis for Cardiac Action Potential Models journal June 2019
Functionalized Anatomical Models for Computational Life Sciences text January 2018
Consideration of a Credibility Assessment Framework in Model‐Informed Drug Development: Potential Application to Physiologically‐Based Pharmacokinetic Modeling and Simulation journal November 2019
Impact of Modeling Assumptions on Stability Predictions in Reverse Total Shoulder Arthroplasty journal August 2018