A space-time parallel algorithm with adaptive mesh refinement for computational fluid dynamics

Christopher, Joshua; Falgout, Robert D.; Schroder, Jacob B.; Guzik, Stephen M.; Gao, Xinfeng

doi:10.1007/s00791-020-00334-1

A space-time parallel algorithm with adaptive mesh refinement for computational fluid dynamics

Journal Article · Sun Sep 27 00:00:00 EDT 2020 · Computing and Visualization in Science

DOI:https://doi.org/10.1007/s00791-020-00334-1· OSTI ID:1734600

Christopher, Joshua ^[1]; Falgout, Robert D. ^[2]; Schroder, Jacob B. ^[3]; Guzik, Stephen M. ^[1]; Gao, Xinfeng ^[1]

Colorado State Univ., Fort Collins, CO (United States)
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Univ. of New Mexico, Albuquerque, NM (United States)

This work describes a space-time parallel algorithm with space-time adaptive mesh refinement (AMR). AMR with subcycling is added to multigrid reduction-in-time (MGRIT) in order to provide solution efficient adaptive grids with a reduction in work performed on coarser grids. This algorithm is achieved by integrating two software libraries: XBraid (Parallel time integration with multigrid. https://computation.llnl.gov/projects/parallel-timeintegration-multigrid) and Chombo (Chombo software package for AMR applications—design document, 2014). The former is a parallel time integration library using multigrid and the latter is a massively parallel structured AMR library. Employing this adaptive space-time parallel algorithm is Chord (Comput Fluids 123:202–217, 2015), a computational fluid dynamics (CFD) application code for solving compressible fluid dynamics problems. For the same solution accuracy, speedups are demonstrated from the use of space-time parallelization over the time-sequential integration on Couette flow and Stokes’ second problem. On a transient Couette flow case, at least a 1.5× speedup is achieved, and with a time periodic problem, a speedup of up to 13.7× over the time-sequential case is obtained. In both cases, the speedup is achieved by adding processors and exploring additional parallelization in time. The numerical experiments show the algorithm is promising for CFD applications that can take advantage of the time parallelism. Future work will focus on improving the parallel performance and providing more tests with complex fluid dynamics to demonstrate the full potential of the algorithm.

View Accepted Manuscript (DOE)

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC52-07NA27344

OSTI ID:: 1734600

Report Number(s):: LLNL-JRNL--798697; 1001255

Journal Information:: Computing and Visualization in Science, Journal Name: Computing and Visualization in Science Journal Issue: 1-4 Vol. 23; ISSN 1432-9360

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

References (44)

Comparison of algebraic multigrid methods for an adaptive space-time finite-element discretization of the heat equation in 3D and 4D: Comparison of AMG for adaptive space-time FEM in 3D and 4D Steinbach, Olaf; Yang, Huidong Numerical Linear Algebra with Applications, Vol. 25, Issue 3 https://doi.org/10.1002/nla.2143	journal	January 2018
Convergence of the multigrid reduction in time algorithm for the linear elasticity equations: Convergence of the MGRIT algorithm for linear elasticity Hessenthaler, A.; Nordsletten, D.; Röhrle, O. Numerical Linear Algebra with Applications, Vol. 25, Issue 3 https://doi.org/10.1002/nla.2155	journal	February 2018
Parallel time integration with multigrid: Parallel time integration with multigrid Falgout, Robert; Friedhoff, Stephanie; Kolev, Tzanio PAMM, Vol. 14, Issue 1 https://doi.org/10.1002/pamm.201410456	journal	December 2014
50 Years of Time Parallel Time Integration Gander, Martin J. Contributions in Mathematical and Computational Sciences https://doi.org/10.1007/978-3-319-23321-5_3	book	January 2015
Multigrid methods with space–time concurrency Falgout, R. D.; Friedhoff, S.; Kolev, Tz. V. Computing and Visualization in Science, Vol. 18, Issue 4-5 https://doi.org/10.1007/s00791-017-0283-9	journal	August 2017
A non-intrusive parallel-in-time adjoint solver with the XBraid library Günther, Stefanie; Gauger, Nicolas R.; Schroder, Jacob B. Computing and Visualization in Science, Vol. 19, Issue 3-4 https://doi.org/10.1007/s00791-018-0300-7	journal	June 2018
A high-performance finite-volume algorithm for solving partial differential equations governing compressible viscous flows on structured grids Guzik, S. M.; Gao, X.; Olschanowsky, C. Computers & Mathematics with Applications, Vol. 72, Issue 9 https://doi.org/10.1016/j.camwa.2016.08.004	journal	November 2016
Guaranteed error bounds and local indicators for adaptive solvers using stabilised space–time IgA approximations to parabolic problems Langer, Ulrich; Matculevich, Svetlana; Repin, Sergey Computers & Mathematics with Applications, Vol. 78, Issue 8 https://doi.org/10.1016/j.camwa.2019.04.009	journal	October 2019
Large-eddy simulation: Past, present and the future Zhiyin, Yang Chinese Journal of Aeronautics, Vol. 28, Issue 1 https://doi.org/10.1016/j.cja.2014.12.007	journal	February 2015
A freestream-preserving fourth-order finite-volume method in mapped coordinates with adaptive-mesh refinement Guzik, Stephen M.; Gao, Xinfeng; Owen, Landon D. Computers & Fluids, Vol. 123 https://doi.org/10.1016/j.compfluid.2015.10.001	journal	December 2015
A high-order adaptive algorithm for multispecies gaseous flows on mapped domains Owen, L. D.; Guzik, S. M.; Gao, X. Computers & Fluids, Vol. 170 https://doi.org/10.1016/j.compfluid.2018.05.010	journal	July 2018
Block structured adaptive mesh and time refinement for hybrid, hyperbolic+N-body systems Miniati, Francesco; Colella, Phillip Journal of Computational Physics, Vol. 227, Issue 1 https://doi.org/10.1016/j.jcp.2007.07.035	journal	November 2007
A cell-centered adaptive projection method for the incompressible Navier–Stokes equations in three dimensions Martin, Daniel F.; Colella, Phillip; Graves, Daniel Journal of Computational Physics, Vol. 227, Issue 3 https://doi.org/10.1016/j.jcp.2007.09.032	journal	January 2008
A limiter for PPM that preserves accuracy at smooth extrema Colella, Phillip; Sekora, Michael D. Journal of Computational Physics, Vol. 227, Issue 15 https://doi.org/10.1016/j.jcp.2008.03.034	journal	July 2008
Techniques for improving monotonicity in a fourth-order finite-volume algorithm solving shocks and detonations Owen, L. D.; Gao, X.; Guzik, S. M. Journal of Computational Physics, Vol. 415 https://doi.org/10.1016/j.jcp.2020.109515	journal	August 2020
A survey of high level frameworks in block-structured adaptive mesh refinement packages Dubey, Anshu; Almgren, Ann; Bell, John Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.07.001	journal	December 2014
An Introduction to Fluid Dynamics Batchelor, G. K. https://doi.org/10.1017/CBO9780511800955	book	June 2012
A non-intrusive parallel-in-time approach for simultaneous optimization with unsteady PDEs Günther, S.; Gauger, N. R.; Schroder, J. B. Optimization Methods and Software, Vol. 34, Issue 6 https://doi.org/10.1080/10556788.2018.1504050	journal	May 2018
Modeling turbulent flow with implicit LES Margolin, L. G.; Rider, W. J.; Grinstein, F. F. Journal of Turbulence, Vol. 7 https://doi.org/10.1080/14685240500331595	journal	January 2006
FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes Fryxell, B.; Olson, K.; Ricker, P. The Astrophysical Journal Supplement Series, Vol. 131, Issue 1 https://doi.org/10.1086/317361	journal	November 2000
Numerical simulation of laminar reacting flows with complex chemistry Day, M. S.; Bell, J. B. Combustion Theory and Modelling, Vol. 4, Issue 4 https://doi.org/10.1088/1364-7830/4/4/309	journal	December 2000
Adaptive Mesh Refinement for Multiscale Nonequilibrium Physics Martin, D. F.; Colella, P.; Anghel, M. Computing in Science and Engineering, Vol. 7, Issue 3 https://doi.org/10.1109/MCSE.2005.45	journal	May 2005
A parallel multigrid reduction in time method for power systems Lecouvez, Matthieu; Falgout, Robert D.; Woodward, Carol S. 2016 IEEE Power and Energy Society General Meeting (PESGM) https://doi.org/10.1109/PESGM.2016.7741520	conference	July 2016
Parallel-in-Time Solution of Power Systems with Scheduled Events Schroder, Jacob B.; Falgout, Robert D.; Woodward, Carol S. 2018 IEEE Power & Energy Society General Meeting (PESGM) https://doi.org/10.1109/PESGM.2018.8586435	conference	August 2018
A Space-Time Multigrid Method for Parabolic Partial Differential Equations Horton, G.; Vandewalle, S. SIAM Journal on Scientific Computing, Vol. 16, Issue 4 https://doi.org/10.1137/0916050	journal	July 1995
A Multigrid Tutorial, Second Edition Briggs, William L.; Henson, Van Emden; McCormick, Steve F. Other Titles in Applied Mathematics https://doi.org/10.1137/1.9780898719505	book	January 2000
A Fourth-Order Accurate Finite-Volume Method with Structured Adaptive Mesh Refinement for Solving the Advection-Diffusion Equation Zhang, Qinghai; Johansen, Hans; Colella, Phillip SIAM Journal on Scientific Computing, Vol. 34, Issue 2 https://doi.org/10.1137/110820105	journal	January 2012
Parallel Time Integration with Multigrid Falgout, R. D.; Friedhoff, S.; Kolev, Tz. V. SIAM Journal on Scientific Computing, Vol. 36, Issue 6 https://doi.org/10.1137/130944230	journal	January 2014
Analysis of a New Space-Time Parallel Multigrid Algorithm for Parabolic Problems Gander, Martin J.; Neumüller, Martin SIAM Journal on Scientific Computing, Vol. 38, Issue 4 https://doi.org/10.1137/15M1046605	journal	January 2016
Parallel-In-Time Multigrid with Adaptive Spatial Coarsening for The Linear Advection and Inviscid Burgers Equations Howse, Alexander J.; Sterck, Hans De; Falgout, Robert D. SIAM Journal on Scientific Computing, Vol. 41, Issue 1 https://doi.org/10.1137/17M1144982	journal	January 2019
Layer-Parallel Training of Deep Residual Neural Networks Günther, Stefanie; Ruthotto, Lars; Schroder, Jacob B. SIAM Journal on Mathematics of Data Science, Vol. 2, Issue 1 https://doi.org/10.1137/19M1247620	journal	January 2020
Parallel solution-adaptive method for two-dimensional non-premixed combusting flows Gao, X.; Northrup, S.; Groth, C. P. T. Progress in Computational Fluid Dynamics, An International Journal, Vol. 11, Issue 2 https://doi.org/10.1504/PCFD.2011.038834	journal	January 2011
Space-Time Finite Element Methods for Parabolic Problems Steinbach, Olaf Computational Methods in Applied Mathematics, Vol. 15, Issue 4 https://doi.org/10.1515/cmam-2015-0026	journal	October 2015
A high-order finite-volume method for conservation laws on locally refined grids McCorquodale, Peter; Colella, Phillip Communications in Applied Mathematics and Computational Science, Vol. 6, Issue 1 https://doi.org/10.2140/camcos.2011.6.1	journal	January 2011
Multi-level adaptive computations in fluid dynamics Brandt, A. 4th Computational Fluid Dynamics Conference https://doi.org/10.2514/6.1979-1455	conference	February 2013
A parallel solution-adaptive scheme for ideal magnetohydrodynamics Groth, C.; De Zeeuw, D.; Powell, K. 14th Computational Fluid Dynamics Conference https://doi.org/10.2514/6.1999-3273	conference	February 2013
Large-Eddy Simulation: Current Capabilities, Recommended Practices, and Future Research Georgiadis, Nicholas; Rizzetta, Donald; Fureby, Christer 47th AIAA Aerospace Sciences Meeting including The New Horizons Forum and Aerospace Exposition https://doi.org/10.2514/6.2009-948	conference	June 2012
A Freestream-Preserving High-Order Finite-Volume Method for Mapped Grids with Adaptive-Mesh Refinement Guzik, Stephen; McCorquodale, Peter; Colella, Phillip 50th AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition https://doi.org/10.2514/6.2012-574	conference	November 2012
A fourth-order boundary treatment for viscous fluxes on Cartesian grid finite-volume methods Gao, Xinfeng; Guzik, Stephen; Colella, Phillip 52nd Aerospace Sciences Meeting https://doi.org/10.2514/6.2014-1277	conference	January 2014
A Fourth-Order Scheme for the Compressible Navier-Stokes Equations Gao, Xinfeng; Guzik, Stephen 53rd AIAA Aerospace Sciences Meeting https://doi.org/10.2514/6.2015-0298	conference	January 2015
A High-Order Finite-Volume Method for Combustion Gao, Xinfeng; Owen, Landon D.; Guzik, Stephen M. 54th AIAA Aerospace Sciences Meeting https://doi.org/10.2514/6.2016-1808	conference	January 2016
A Fourth-Order Finite-Volume Algorithm for Compressible Flow with Chemical Reactions on Mapped Grids Owen, Landon D.; Guzik, Stephen; Gao, Xinfeng 23rd AIAA Computational Fluid Dynamics Conference https://doi.org/10.2514/6.2017-4498	conference	June 2017
Parallel In Time for a Fully Space-Time Adaptive Mesh Refinement Algorithm Christopher, Joshua; Gao, Xinfeng; Guzik, Stephen M. AIAA Scitech 2020 Forum https://doi.org/10.2514/6.2020-0340	conference	January 2020
Overnight Industrial LES for External Aerodynamics Lohner, Rainald; Othmer, Carsten; Mrosek, Markus AIAA Scitech 2020 Forum https://doi.org/10.2514/6.2020-2031	conference	January 2020

Similar Records

Two-Level Convergence Theory for Multigrid Reduction in Time (MGRIT)

Journal Article · Thu Oct 26 00:00:00 EDT 2017 · SIAM Journal on Scientific Computing · OSTI ID:1764758

Multigrid Reduction in Time for Chaotic and Hyperbolic Problems (Final Report)

Technical Report · Mon Aug 07 00:00:00 EDT 2023 · OSTI ID:1994037

Parallel time integration software

Software · Tue Jul 01 00:00:00 EDT 2014 · OSTI ID:1231937

Related Subjects

97 MATHEMATICS AND COMPUTING
MGRIT
adaptivity
finite-volume
high-order CFD
mathematics and computing
mesh parallel-in-time
multigrid
time-parallel

A space-time parallel algorithm with adaptive mesh refinement for computational fluid dynamics

Citation Formats

References (44)

Similar Records

Related Subjects