Simulation of unsteady blood flows in a patient-specific compliant pulmonary artery with a highly parallel monolithically coupled fluid-structure interaction algorithm

Kong, Fande; Kheyfets, Vitaly; Finol, Ender; Cai, Xiao‐Chuan

doi:10.1002/cnm.3208

Simulation of unsteady blood flows in a patient-specific compliant pulmonary artery with a highly parallel monolithically coupled fluid-structure interaction algorithm

Journal Article · Tue Apr 16 00:00:00 EDT 2019 · International Journal for Numerical Methods in Biomedical Engineering

DOI:https://doi.org/10.1002/cnm.3208· OSTI ID:1631720

^[1]; Kheyfets, Vitaly ^[2]; Finol, Ender ^[3]; ^[4]

Idaho National Lab. (INL), Idaho Falls, ID (United States)
Univ. of Colorado Denver, Aurora, CO (United States)
Univ. of Texas at San Antonio, TX (United States)
Univ. of Colorado, Boulder, CO (United States)

Computational fluid dynamics (CFD) is increasingly used to study blood flows in patient-specific arteries for understanding certain cardiovascular diseases. The techniques work quite well for relatively simple problems, but need improvements when the problems become harder in the case when (1) the geometry becomes complex (from a few branches to a full pulmonary artery), (2) the model becomes more complex (from fluid-only calculation to coupled fluid-structure interaction calculation), (3) both the fluid and wall models become highly nonlinear, and (4) the computer on which we run the simulation is a supercomputer with tens of thousands of processor cores. To push the limit of CFD in all four fronts, in this paper, we develop and study a highly parallel algorithm for solving a monolithically coupled fluid-structure system for the modeling of the interaction of the blood flow and the arterial wall. As a case study, we consider a patient-specific, full size pulmonary artery obtained from CT (Computed Tomography) images, with an artificially added layer of wall with a fixed thickness. The fluid is modeled with a system of incompressible Navier-Stokes equations and the wall is modeled by a geometrically nonlinear elasticity equation. As far as we know this is the first time the unsteady blood flow in a full pulmonary artery is simulated without assuming a rigid wall. We report the proposed numerical algorithm and software scale well beyond 10,000 processor cores on a supercomputer for solving the fluid-structure interaction problem discretized with a stabilized finite element method in space and an implicit scheme in time involving hundreds of millions of unknowns.

View Accepted Manuscript (DOE)

Research Organization:: Idaho National Laboratory (INL), Idaho Falls, ID (United States)

Sponsoring Organization:: National Science Foundation (NSF); USDOE Office of Energy Efficiency and Renewable Energy (EERE); USDOE Office of Nuclear Energy (NE)

Grant/Contract Number:: AC07-05ID14517

OSTI ID:: 1631720

Alternate ID(s):: OSTI ID: 1633723

Report Number(s):: INL/JOU--18-45017; INL/JOU--18-51734-Rev001

Journal Information:: International Journal for Numerical Methods in Biomedical Engineering, Journal Name: International Journal for Numerical Methods in Biomedical Engineering Journal Issue: 7 Vol. 35; ISSN 2040-7939

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

References (38)

A stabilized finite element method for the incompressible Navier-Stokes equations using a hierarchical basis Whiting, Christian H.; Jansen, Kenneth E. International Journal for Numerical Methods in Fluids, Vol. 35, Issue 1 https://doi.org/10.1002/1097-0363(20010115)35:1<93::AID-FLD85>3.0.CO;2-G	journal	January 2001
Efficient solvers for coupled models in respiratory mechanics: EFFICIENT SOLVERS FOR COUPLED MODELS IN RESPIRATORY MECHANICS Verdugo, Francesc; Roth, Christian J.; Yoshihara, Lena International Journal for Numerical Methods in Biomedical Engineering, Vol. 33, Issue 2 https://doi.org/10.1002/cnm.2795	journal	May 2016
An efficient parallel simulation of unsteady blood flows in patient-specific pulmonary artery: An efficient parallel simulation of unsteady blood flows in patient-specific pulmonary artery Kong, Fande; Kheyfets, Vitaly; Finol, Ender International Journal for Numerical Methods in Biomedical Engineering, Vol. 34, Issue 4 https://doi.org/10.1002/cnm.2952	journal	February 2018
4D magnetic resonance flow imaging for estimating pulmonary vascular resistance in pulmonary hypertension: Estimating PVR With MRI Kheyfets, Vitaly O.; Schafer, Michal; Podgorski, Chris A. Journal of Magnetic Resonance Imaging, Vol. 44, Issue 4 https://doi.org/10.1002/jmri.25251	journal	May 2016
A fully coupled two-level Schwarz preconditioner based on smoothed aggregation for the transient multigroup neutron diffusion equations: A parallel preconditioner for the multigroup diffusion equations Kong, Fande; Wang, Yaqi; Schunert, Sebastian Numerical Linear Algebra with Applications, Vol. 25, Issue 3 https://doi.org/10.1002/nla.2162	journal	February 2018
Isogeometric Fluid–structure Interaction Analysis with Applications to Arterial Blood Flow Bazilevs, Y.; Calo, V. M.; Zhang, Y. Computational Mechanics, Vol. 38, Issue 4-5 https://doi.org/10.1007/s00466-006-0084-3	journal	June 2006
Numerical simulation of blood flow and pressure drop in the pulmonary arterial and venous circulation Qureshi, M. Umar; Vaughan, Gareth D. A.; Sainsbury, Christopher Biomechanics and Modeling in Mechanobiology, Vol. 13, Issue 5 https://doi.org/10.1007/s10237-014-0563-y	journal	March 2014
Morphometry-Based Impedance Boundary Conditions for Patient-Specific Modeling of Blood Flow in Pulmonary Arteries Spilker, Ryan L.; Feinstein, Jeffrey A.; Parker, David W. Annals of Biomedical Engineering, Vol. 35, Issue 4 https://doi.org/10.1007/s10439-006-9240-3	journal	February 2007
Three-Dimensional Hemodynamics in the Human Pulmonary Arteries Under Resting and Exercise Conditions Tang, Beverly T.; Fonte, Tim A.; Chan, Frandics P. Annals of Biomedical Engineering, Vol. 39, Issue 1 https://doi.org/10.1007/s10439-010-0124-1	journal	July 2010
Pulmonary Arterial Stiffness: Toward a New Paradigm in Pulmonary Arterial Hypertension Pathophysiology and Assessment Schäfer, Michal; Myers, Cynthia; Brown, R. Dale Current Hypertension Reports, Vol. 18, Issue 1 https://doi.org/10.1007/s11906-015-0609-2	journal	January 2016
Load and motion transfer algorithms for fluid/structure interaction problems with non-matching discrete interfaces: Momentum and energy conservation, optimal discretization and application to aeroelasticity Farhat, C.; Lesoinne, M.; Le Tallec, P. Computer Methods in Applied Mechanics and Engineering, Vol. 157, Issue 1-2 https://doi.org/10.1016/S0045-7825(97)00216-8	journal	April 1998
Finite element modeling of blood flow in arteries Taylor, Charles A.; Hughes, Thomas J. R.; Zarins, Christopher K. Computer Methods in Applied Mechanics and Engineering, Vol. 158, Issue 1-2 https://doi.org/10.1016/S0045-7825(98)80008-X	journal	May 1998
ALE formulation for fluid–structure interaction problems Souli, M.; Ouahsine, A.; Lewin, L. Computer Methods in Applied Mechanics and Engineering, Vol. 190, Issue 5-7 https://doi.org/10.1016/S0045-7825(99)00432-6	journal	November 2000
Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the Global Burden of Disease Study 2015 Wang, Haidong; Naghavi, Mohsen; Allen, Christine The Lancet, Vol. 388, Issue 10053 https://doi.org/10.1016/S0140-6736(16)31012-1	journal	October 2016
Provably second-order time-accurate loosely-coupled solution algorithms for transient nonlinear computational aeroelasticity Farhat, Charbel; van der Zee, Kristoffer G.; Geuzaine, Philippe Computer Methods in Applied Mechanics and Engineering, Vol. 195, Issue 17-18 https://doi.org/10.1016/j.cma.2004.11.031	journal	March 2006
Added-mass effect in the design of partitioned algorithms for fluid–structure problems Causin, P.; Gerbeau, J. F.; Nobile, F. Computer Methods in Applied Mechanics and Engineering, Vol. 194, Issue 42-44 https://doi.org/10.1016/j.cma.2004.12.005	journal	October 2005
Impact of pulmonary vascular stiffness and vasodilator treatment in pediatric pulmonary hypertension: 21 patient-specific fluid–structure interaction studies Su, Zhenbi; Hunter, Kendall S.; Shandas, Robin Computer Methods and Programs in Biomedicine, Vol. 108, Issue 2 https://doi.org/10.1016/j.cmpb.2011.09.002	journal	November 2012
Patient-specific computational modeling of blood flow in the pulmonary arterial circulation Kheyfets, Vitaly O.; Rios, Lourdes; Smith, Triston Computer Methods and Programs in Biomedicine, Vol. 120, Issue 2 https://doi.org/10.1016/j.cmpb.2015.04.005	journal	July 2015
Fluid–structure interaction simulation of aortic blood flow Crosetto, Paolo; Reymond, Philippe; Deparis, Simone Computers & Fluids, Vol. 43, Issue 1 https://doi.org/10.1016/j.compfluid.2010.11.032	journal	April 2011
Fluid-structure interaction in a pulmonary arterial bifurcation Yang, X. L.; Liu, Y.; Yang, J. M. Journal of Biomechanics, Vol. 40, Issue 12 https://doi.org/10.1016/j.jbiomech.2007.01.008	journal	January 2007
Scalable parallel methods for monolithic coupling in fluid–structure interaction with application to blood flow modeling Barker, Andrew T.; Cai, Xiao-Chuan Journal of Computational Physics, Vol. 229, Issue 3 https://doi.org/10.1016/j.jcp.2009.10.001	journal	February 2010
A fully implicit domain decomposition based ALE framework for three-dimensional fluid–structure interaction with application in blood flow computation Wu, Yuqi; Cai, Xiao-Chuan Journal of Computational Physics, Vol. 258 https://doi.org/10.1016/j.jcp.2013.10.046	journal	February 2014
A scalable nonlinear fluid–structure interaction solver based on a Schwarz preconditioner with isogeometric unstructured coarse spaces in 3D Kong, Fande; Cai, Xiao-Chuan Journal of Computational Physics, Vol. 340 https://doi.org/10.1016/j.jcp.2017.03.043	journal	July 2017
Reduced shear stress and associated aortic deformation in the thoracic aorta of patients with chronic obstructive pulmonary disease Schäfer, Michal; Kheyfets, Vitaly O.; Barker, Alex J. Journal of Vascular Surgery, Vol. 68, Issue 1 https://doi.org/10.1016/j.jvs.2017.06.110	journal	July 2018
The Role of Wall Shear Stress in the Assessment of Right Ventricle Hydraulic Workload Kheyfets, Vitaly; Thirugnanasambandam, Mirunalini; Rios, Lourdes Pulmonary Circulation, Vol. 5, Issue 1 https://doi.org/10.1086/679703	journal	March 2015
Main Pulmonary Arterial Wall Shear Stress Correlates with Invasive Hemodynamics and Stiffness in Pulmonary Hypertension Schäfer, Michal; Kheyfets, Vitaly O.; Schroeder, Joyce D. Pulmonary Circulation, Vol. 6, Issue 1 https://doi.org/10.1086/685024	journal	March 2016
4D-flow cardiac magnetic resonance-derived vorticity is sensitive marker of left ventricular diastolic dysfunction in patients with mild-to-moderate chronic obstructive pulmonary disease Schäfer, Michal; Humphries, Stephen; Stenmark, Kurt R. European Heart Journal - Cardiovascular Imaging, Vol. 19, Issue 4 https://doi.org/10.1093/ehjci/jex069	journal	April 2017
Simulations of Congenital Septal Defect Closure and Reactivity Testing in Patient-Specific Models of the Pediatric Pulmonary Vasculature: A 3D Numerical Study With Fluid-Structure Interaction Hunter, Kendall S.; Lanning, Craig J.; Chen, Shiuh-Yung J. Journal of Biomechanical Engineering, Vol. 128, Issue 4 https://doi.org/10.1115/1.2206202	journal	January 2006
Inexact Newton Methods Dembo, Ron S.; Eisenstat, Stanley C.; Steihaug, Trond SIAM Journal on Numerical Analysis, Vol. 19, Issue 2 https://doi.org/10.1137/0719025	journal	April 1982
Iterative Methods for Sparse Linear Systems Saad, Yousef https://doi.org/10.1137/1.9780898718003	book	January 2003
Numerical Methods for Unconstrained Optimization and Nonlinear Equations Dennis, J. E.; Schnabel, Robert B. Classics in Applied Mathematics https://doi.org/10.1137/1.9781611971200	book	January 1996
A Highly Scalable Multilevel Schwarz Method with Boundary Geometry Preserving Coarse Spaces for 3D Elasticity Problems on Domains with Complex Geometry Kong, Fande; Cai, Xiao-Chuan SIAM Journal on Scientific Computing, Vol. 38, Issue 2 https://doi.org/10.1137/15M1010567	journal	January 2016
In vivo measurement of proximal pulmonary artery elastic modulus in the neonatal calf model of pulmonary hypertension: development and ex vivo validation Hunter, Kendall S.; Albietz, Joseph A.; Lee, Po-Feng Journal of Applied Physiology, Vol. 108, Issue 4 https://doi.org/10.1152/japplphysiol.01173.2009	journal	April 2010
Mechanisms of Arterial Remodeling in Hypertension: Coupled Roles of Wall Shear and Intramural Stress Humphrey, Jay D. Hypertension, Vol. 52, Issue 2 https://doi.org/10.1161/HYPERTENSIONAHA.107.103440	journal	August 2008
Scalability study of an implicit solver for coupled fluid-structure interaction problems on unstructured meshes in 3D Kong, Fande; Cai, Xiao-Chuan The International Journal of High Performance Computing Applications, Vol. 32, Issue 2 https://doi.org/10.1177/1094342016646437	journal	May 2016
Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the Global Burden of Disease Study 2015 Pete,, Nkamedjie; Donkelaar,, van; Razek,, Magdy Abd El The University of North Carolina at Chapel Hill University Libraries https://doi.org/10.17615/pn3w-mb24	text	January 2016
Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980-2015: a systematic analysis for the Global Burden of Disease Study 2015. Collaborators, GBD 2015 Mortality And Causes Of Death Elsevier BV https://doi.org/10.17863/cam.15722	journalarticle	January 2016
In Vivo and in Vitro Measurements of Pulmonary Arterial Stiffness: A Brief Review Tian, Lian; Chester, Naomi C. Pulmonary Circulation, Vol. 2, Issue 4 https://doi.org/10.4103/2045-8932.105040	journal	October 2012

Similar Records

An efficient parallel simulation of unsteady blood flows in patient-specific pulmonary artery

Journal Article · Thu Dec 14 19:00:00 EST 2017 · International Journal for Numerical Methods in Biomedical Engineering · OSTI ID:1484705

Related Subjects

97 MATHEMATICS AND COMPUTING
domain decomposition
finite element
fluid-structure interaction
parallel processing
patient-specific pulmonary artery
unsteady blood flows

Simulation of unsteady blood flows in a patient-specific compliant pulmonary artery with a highly parallel monolithically coupled fluid-structure interaction algorithm

Citation Formats

References (38)

Similar Records

Related Subjects