DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere

Abstract

The modeling of atmospheric processes in the context of weather and climate simulations is an important and computationally expensive challenge. The temporal integration of the underlying PDEs requires a very large number of time steps, even when the terms accounting for the propagation of fast atmospheric waves are treated implicitly. Therefore, the use of parallel-in-time integration schemes to reduce the time-to-solution is of increasing interest, particularly in the numerical weather forecasting field. We present a multi-level parallel-in-time integration method combining the Parallel Full Approximation Scheme in Space and Time (PFASST) with a spatial discretization based on Spherical Harmonics (SH). The iterative algorithm computes multiple time steps concurrently by interweaving parallel high-order fine corrections and serial corrections performed on a coarsened problem. To do that, we design a methodology relying on the spectral basis of the SH to coarsen and interpolate the problem in space. Finally, the methods are evaluated on the shallow-water equations on the sphere using a set of tests commonly used in the atmospheric flow community. We assess the convergence of PFASST-SH upon refinement in time. We also investigate the impact of the coarsening strategy on the accuracy of the scheme, and specifically on its ability to capturemore » the high-frequency modes accumulating in the solution. Finally, we study the computational cost of PFASST-SH to demonstrate that our scheme resolves the main features of the solution multiple times faster than the serial schemes.« less

Authors:
ORCiD logo [1];  [2];  [1]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  2. Technical Univ. of Munich (Germany)
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI Identifier:
1581338
Alternate Identifier(s):
OSTI ID: 1703202
Grant/Contract Number:  
AC02-05CH11231; AC02005CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 407; Journal Issue: C; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; Parallel-in-time integration; Multi-level spectral deferred corrections; Spherical harmonics; Shallow-water equations on the sphere; Atmospheric flows; Climate and weather simulations

Citation Formats

Hamon, François P., Schreiber, Martin, and Minion, Michael L. Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere. United States: N. p., 2019. Web. doi:10.1016/j.jcp.2019.109210.
Hamon, François P., Schreiber, Martin, & Minion, Michael L. Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere. United States. https://doi.org/10.1016/j.jcp.2019.109210
Hamon, François P., Schreiber, Martin, and Minion, Michael L. Tue . "Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere". United States. https://doi.org/10.1016/j.jcp.2019.109210. https://www.osti.gov/servlets/purl/1581338.
@article{osti_1581338,
title = {Parallel-in-time multi-level integration of the shallow-water equations on the rotating sphere},
author = {Hamon, François P. and Schreiber, Martin and Minion, Michael L.},
abstractNote = {The modeling of atmospheric processes in the context of weather and climate simulations is an important and computationally expensive challenge. The temporal integration of the underlying PDEs requires a very large number of time steps, even when the terms accounting for the propagation of fast atmospheric waves are treated implicitly. Therefore, the use of parallel-in-time integration schemes to reduce the time-to-solution is of increasing interest, particularly in the numerical weather forecasting field. We present a multi-level parallel-in-time integration method combining the Parallel Full Approximation Scheme in Space and Time (PFASST) with a spatial discretization based on Spherical Harmonics (SH). The iterative algorithm computes multiple time steps concurrently by interweaving parallel high-order fine corrections and serial corrections performed on a coarsened problem. To do that, we design a methodology relying on the spectral basis of the SH to coarsen and interpolate the problem in space. Finally, the methods are evaluated on the shallow-water equations on the sphere using a set of tests commonly used in the atmospheric flow community. We assess the convergence of PFASST-SH upon refinement in time. We also investigate the impact of the coarsening strategy on the accuracy of the scheme, and specifically on its ability to capture the high-frequency modes accumulating in the solution. Finally, we study the computational cost of PFASST-SH to demonstrate that our scheme resolves the main features of the solution multiple times faster than the serial schemes.},
doi = {10.1016/j.jcp.2019.109210},
journal = {Journal of Computational Physics},
number = C,
volume = 407,
place = {United States},
year = {2019},
month = {12}
}

Works referenced in this record:

Numerical investigation of Rossby waves for nonlinear shallow‐water equations on the sphere
journal, March 2019

  • Bénard, Pierre
  • Quarterly Journal of the Royal Meteorological Society, Vol. 145, Issue 721
  • DOI: 10.1002/qj.3504

A multigrid perspective on the parallel full approximation scheme in space and time: A multigrid perspective on PFASST
journal, June 2017

  • Bolten, Matthias; Moser, Dieter; Speck, Robert
  • Numerical Linear Algebra with Applications, Vol. 24, Issue 6
  • DOI: 10.1002/nla.2110

Asymptotic convergence of the parallel full approximation scheme in space and time for linear problems: Asymptotic convergence of PFASST for linear problems
journal, August 2018

  • Bolten, Matthias; Moser, Dieter; Speck, Robert
  • Numerical Linear Algebra with Applications, Vol. 25, Issue 6
  • DOI: 10.1002/nla.2208

An Efficient, One-Level, Primitive-Equation Spectral Model
journal, September 1972


High-order multi-implicit spectral deferred correction methods for problems of reactive flow
journal, August 2003


Multi-level adaptive solutions to boundary-value problems
journal, May 1977


Comments on high-order integrators embedded within integral deferred correction methods
journal, January 2009

  • Christlieb, Andrew; Ong, Benjamin; Qiu, Jing-Mei
  • Communications in Applied Mathematics and Computational Science, Vol. 4, Issue 1
  • DOI: 10.2140/camcos.2009.4.27

Toward an efficient parallel in time method for partial differential equations
journal, January 2012

  • Emmett, Matthew; Minion, Michael
  • Communications in Applied Mathematics and Computational Science, Vol. 7, Issue 1
  • DOI: 10.2140/camcos.2012.7.105

Accuracy Analysis of a Spectral Element Atmospheric Model Using a Fully Implicit Solution Framework
journal, August 2010

  • Evans, Katherine J.; Taylor, Mark A.; Drake, John B.
  • Monthly Weather Review, Vol. 138, Issue 8
  • DOI: 10.1175/2010MWR3288.1

Parallel Time Integration with Multigrid
journal, January 2014

  • Falgout, R. D.; Friedhoff, S.; Kolev, Tz. V.
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 6
  • DOI: 10.1137/130944230

Time-decomposed parallel time-integrators: theory and feasibility studies for fluid, structure, and fluid-structure applications
journal, January 2003

  • Farhat, Charbel; Chandesris, Marion
  • International Journal for Numerical Methods in Engineering, Vol. 58, Issue 9
  • DOI: 10.1002/nme.860

An initial-value problem for testing numerical models of the global shallow-water equations
journal, January 2004

  • Galewsky, Joseph; Scott, Richard K.; Polvani, Lorenzo M.
  • Tellus A: Dynamic Meteorology and Oceanography, Vol. 56, Issue 5
  • DOI: 10.3402/tellusa.v56i5.14436

A waveform relaxation algorithm with overlapping splitting for reaction diffusion equations
journal, March 1999


PARAEXP: A Parallel Integrator for Linear Initial-Value Problems
journal, January 2013

  • Gander, Martin J.; Güttel, Stefan
  • SIAM Journal on Scientific Computing, Vol. 35, Issue 2
  • DOI: 10.1137/110856137

Implicit–explicit (IMEX) Runge–Kutta methods for non-hydrostatic atmospheric models
journal, January 2018

  • Gardner, David J.; Guerra, Jorge E.; Hamon, François P.
  • Geoscientific Model Development, Vol. 11, Issue 4
  • DOI: 10.5194/gmd-11-1497-2018

Spectral Viscosity for Shallow Water Equations in Spherical Geometry
journal, September 2001


Semi-implicit time-integrators for a scalable spectral element atmospheric model
journal, July 2005

  • Giraldo, Francis X.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 610
  • DOI: 10.1256/qj.03.218

Implicit-Explicit Formulations of a Three-Dimensional Nonhydrostatic Unified Model of the Atmosphere (NUMA)
journal, January 2013

  • Giraldo, F. X.; Kelly, J. F.; Constantinescu, E. M.
  • SIAM Journal on Scientific Computing, Vol. 35, Issue 5
  • DOI: 10.1137/120876034

Concurrent implicit spectral deferred correction scheme for low-Mach number combustion with detailed chemistry
journal, October 2018


Multi-level spectral deferred corrections scheme for the shallow water equations on the rotating sphere
journal, January 2019

  • Hamon, François P.; Schreiber, Martin; Minion, Michael L.
  • Journal of Computational Physics, Vol. 376
  • DOI: 10.1016/j.jcp.2018.09.042

An Asymptotic Parallel-in-Time Method for Highly Oscillatory PDEs
journal, January 2014

  • Haut, Terry; Wingate, Beth
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 2
  • DOI: 10.1137/130914577

A Spectral Deferred Correction Method Applied to the Shallow Water Equations on a Sphere
journal, October 2013

  • Jia, Jun; Hill, Judith C.; Evans, Katherine J.
  • Monthly Weather Review, Vol. 141, Issue 10
  • DOI: 10.1175/MWR-D-12-00048.1

Description of the JMA Operational Spectral Model [JMA•スペクトルモデルについて]
journal, January 1983

  • Kanamitsu, M.; Tada, K.; Kudo, T.
  • Journal of the Meteorological Society of Japan. Ser. II, Vol. 61, Issue 6
  • DOI: 10.2151/jmsj1965.61.6_812

Conservative multi-implicit spectral deferred correction methods for reacting gas dynamics
journal, March 2004


Résolution d'EDP par un schéma en temps «pararéel »
journal, April 2001

  • Lions, Jacques-Louis; Maday, Yvon; Turinici, Gabriel
  • Comptes Rendus de l'Académie des Sciences - Series I - Mathematics, Vol. 332, Issue 7
  • DOI: 10.1016/S0764-4442(00)01793-6

Numerical analyses of Runge-Kutta implicit-explicit schemes for horizontally explicit, vertically implicit solutions of atmospheric models: Numerical Analyses of RK HEVI Solutions
journal, February 2014

  • Lock, S. -J.; Wood, N.; Weller, H.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 140, Issue 682
  • DOI: 10.1002/qj.2246

Algorithmically scalable block preconditioner for fully implicit shallow-water equations in CAM-SE
journal, October 2014

  • Lott, P. Aaron; Woodward, Carol S.; Evans, Katherine J.
  • Computational Geosciences, Vol. 19, Issue 1
  • DOI: 10.1007/s10596-014-9447-6

Semi-implicit spectral deferred correction methods for ordinary differential equations
journal, January 2003


A hybrid parareal spectral deferred corrections method
journal, January 2010

  • Minion, Michael
  • Communications in Applied Mathematics and Computational Science, Vol. 5, Issue 2
  • DOI: 10.2140/camcos.2010.5.265

An Efficient Spectral Dynamical Core for Distributed Memory Computers
journal, May 2002


An Implicit Time Integration Scheme for Baroclinic Models of the Atmosphere
journal, May 1972


Wave propagation characteristics of Parareal
journal, May 2018


Spectral Deferred Corrections with Fast-wave Slow-wave Splitting
journal, January 2016

  • Ruprecht, Daniel; Speck, Robert
  • SIAM Journal on Scientific Computing, Vol. 38, Issue 4
  • DOI: 10.1137/16M1060078

Efficient spherical harmonic transforms aimed at pseudospectral numerical simulations: EFFICIENT SPHERICAL HARMONIC TRANSFORM
journal, March 2013

  • Schaeffer, Nathanaël
  • Geochemistry, Geophysics, Geosystems, Vol. 14, Issue 3
  • DOI: 10.1002/ggge.20071

A numerical study of a semi-Lagrangian Parareal method applied to the viscous Burgers equation
journal, June 2018

  • Schmitt, A.; Schreiber, M.; Peixoto, P.
  • Computing and Visualization in Science, Vol. 19, Issue 1-2
  • DOI: 10.1007/s00791-018-0294-1

Exponential integrators with parallel-in-time rational approximations for the shallow-water equations on the rotating sphere
journal, July 2019


A consistent framework for discrete integrations of soundproof and compressible PDEs of atmospheric dynamics
journal, April 2014

  • Smolarkiewicz, Piotr K.; Kühnlein, Christian; Wedi, Nils P.
  • Journal of Computational Physics, Vol. 263
  • DOI: 10.1016/j.jcp.2014.01.031

Shallow Water Flow on the Sphere
journal, December 2004

  • Swarztrauber, Paul N.
  • Monthly Weather Review, Vol. 132, Issue 12
  • DOI: 10.1175/MWR2829.1

On Scalar and Vector Transform Methods for Global Spectral Models
journal, May 1991


Numerical simulations of Rossby–Haurwitz waves
journal, January 2000


Operator-Split Runge–Kutta–Rosenbrock Methods for Nonhydrostatic Atmospheric Models
journal, April 2012


A Fast Spherical Harmonics Transform for Global NWP and Climate Models
journal, October 2013

  • Wedi, Nils P.; Hamrud, Mats; Mozdzynski, George
  • Monthly Weather Review, Vol. 141, Issue 10
  • DOI: 10.1175/MWR-D-13-00016.1

Faster SDC convergence on non-equidistant grids by DIRK sweeps
journal, December 2014


Runge–Kutta IMEX schemes for the Horizontally Explicit/Vertically Implicit (HEVI) solution of wave equations
journal, November 2013


A standard test set for numerical approximations to the shallow water equations in spherical geometry
journal, September 1992