Accelerating Time Integration for the Shallow Water Equations on the Sphere Using GPUs

Archibald, R.; Evans, K. J.; Salinger, A.

doi:10.1016/j.procs.2015.05.470

Accelerating Time Integration for the Shallow Water Equations on the Sphere Using GPUs

Journal Article · Mon Jun 01 00:00:00 EDT 2015 · Procedia Computer Science

DOI:https://doi.org/10.1016/j.procs.2015.05.470· OSTI ID:1214700

Archibald, R. ^[1]; Evans, K. J. ^[1]; Salinger, A. ^[2]

Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

The push towards larger and larger computational platforms has made it possible for climate simulations to resolve climate dynamics across multiple spatial and temporal scales. This direction in climate simulation has created a strong need to develop scalable time-stepping methods capable of accelerating throughput on high performance computing. This work details the recent advances in the implementation of implicit time stepping on a spectral element cube-sphere grid using graphical processing units (GPU) based machines. We demonstrate how solvers in the Trilinos project are interfaced with ACME and GPU kernels can significantly increase computational speed of the residual calculations in the implicit time stepping method for the shallow water equations on the sphere. We show the optimization gains and data structure reorganization that facilitates the performance improvements.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Sandia National Laboratories (SNL), Albuquerque, NM, and Livermore, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Biological and Environmental Research (BER) (SC-23); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1214700

Alternate ID(s):: OSTI ID: 1265329

Journal Information:: Procedia Computer Science, Journal Name: Procedia Computer Science Journal Issue: C Vol. 51; ISSN 1877-0509

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (22)

The Spectral Element Method for the Shallow Water Equations on the Sphere Taylor, Mark; Tribbia, Joseph; Iskandarani, Mohamed Journal of Computational Physics, Vol. 130, Issue 1 https://doi.org/10.1006/jcph.1996.5554	journal	January 1997
Conservative Finite-Difference Approximations of the Primitive Equations on Quasi-Uniform Spherical Grids Sadourny, Robert Monthly Weather Review, Vol. 100, Issue 2 https://doi.org/10.1175/1520-0493(1972)100<0136:cfaotp>2.3.co;2	journal	February 1972
A spectral element shallow water model on spherical geodesic grids Giraldo, Francis X. International Journal for Numerical Methods in Fluids, Vol. 35, Issue 8 https://doi.org/10.1002/1097-0363(20010430)35:8<869::AID-FLD116>3.0.CO;2-S	journal	January 2001
A Scalable and Adaptable Solution Framework within Components of the Community Climate System Model Evans, Katherine J.; Rouson, Damian W. I.; Salinger, Andrew G. Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-01973-9_37	book	January 2009
Multirate extrapolation methods for differential equations with different time scales Engstler, Ch.; Lubich, Ch. Computing, Vol. 58, Issue 2 https://doi.org/10.1007/BF02684438	journal	June 1997
Multirate Explicit Adams Methods for Time Integration of Conservation Laws Sandu, Adrian; Constantinescu, Emil M. Journal of Scientific Computing, Vol. 38, Issue 2 https://doi.org/10.1007/s10915-008-9235-3	journal	August 2008
A standard test set for numerical approximations to the shallow water equations in spherical geometry Williamson, David L.; Drake, John B.; Hack, James J. Journal of Computational Physics, Vol. 102, Issue 1 https://doi.org/10.1016/S0021-9991(05)80016-6	journal	September 1992
Comparative performance of exponential, implicit, and explicit integrators for stiff systems of ODEs Loffeld, J.; Tokman, M. Journal of Computational and Applied Mathematics, Vol. 241 https://doi.org/10.1016/j.cam.2012.09.038	journal	March 2013
Jacobian-free Newton–Krylov methods: a survey of approaches and applications Knoll, D. A.; Keyes, D. E. Journal of Computational Physics, Vol. 193, Issue 2 https://doi.org/10.1016/j.jcp.2003.08.010	journal	January 2004
Parallel multilevel methods for implicit solution of shallow water equations with nonsmooth topography on the cubed-sphere Yang, Chao; Cai, Xiao-Chuan Journal of Computational Physics, Vol. 230, Issue 7 https://doi.org/10.1016/j.jcp.2010.12.027	journal	April 2011
Multi-moment ADER-Taylor methods for systems of conservation laws with source terms in one dimension Norman, M. R.; Finkel, H. Journal of Computational Physics, Vol. 231, Issue 20 https://doi.org/10.1016/j.jcp.2012.05.029	journal	August 2012
Algorithmic improvements for schemes using the ADER time discretization Norman, M. R. Journal of Computational Physics, Vol. 243 https://doi.org/10.1016/j.jcp.2013.03.003	journal	June 2013
Heterogeneous multiscale methods for stiff ordinary differential equations Engquist, Bjorn; Tsai, Yen-Hsi Mathematics of Computation, Vol. 74, Issue 252 https://doi.org/10.1090/S0025-5718-05-01745-X	journal	May 2005
Newton-GMRES Preconditioning for Discontinuous Galerkin Discretizations of the Navier–Stokes Equations Persson, P. -O.; Peraire, J. SIAM Journal on Scientific Computing, Vol. 30, Issue 6 https://doi.org/10.1137/070692108	journal	January 2008
An Asymptotic Parallel-in-Time Method for Highly Oscillatory PDEs Haut, Terry; Wingate, Beth SIAM Journal on Scientific Computing, Vol. 36, Issue 2 https://doi.org/10.1137/130914577	journal	January 2014
An overview of the Trilinos project Heroux, Michael A.; Phipps, Eric T.; Salinger, Andrew G. ACM Transactions on Mathematical Software, Vol. 31, Issue 3 https://doi.org/10.1145/1089014.1089021	journal	September 2005
Scalable parallel programming with CUDA Nickolls, John; Buck, Ian; Garland, Michael Queue, Vol. 6, Issue 2 https://doi.org/10.1145/1365490.1365500	journal	March 2008
Compiler support for the Fortran 2003 and 2008 standards revision 10 Chivers, Ian D.; Sleightholme, Jane ACM SIGPLAN Fortran Forum, Vol. 31, Issue 2 https://doi.org/10.1145/2338786.2338789	journal	July 2012
Conservative Finite-Difference Approximations of the Primitive Equations on Quasi-Uniform Spherical Grids Sadourny, Robert Monthly Weather Review, Vol. 100, Issue 2 https://doi.org/10.1175/1520-0493(1972)100<0136:CFAOTP>2.3.CO;2	journal	February 1972
Accuracy Analysis of a Spectral Element Atmospheric Model Using a Fully Implicit Solution Framework Evans, Katherine J.; Taylor, Mark A.; Drake, John B. Monthly Weather Review, Vol. 138, Issue 8 https://doi.org/10.1175/2010MWR3288.1	journal	August 2010
A Spectral Deferred Correction Method Applied to the Shallow Water Equations on a Sphere Jia, Jun; Hill, Judith C.; Evans, Katherine J. Monthly Weather Review, Vol. 141, Issue 10 https://doi.org/10.1175/MWR-D-12-00048.1	journal	October 2013
An initial-value problem for testing numerical models of the global shallow-water equations Galewsky, Joseph; Scott, Richard K.; Polvani, Lorenzo M. Tellus A: Dynamic Meteorology and Oceanography, Vol. 56, Issue 5 https://doi.org/10.3402/tellusa.v56i5.14436	journal	January 2004

Cited By (2)

Acceleration of the Implicit-Explicit Non-hydrostatic Unified Model of the Atmosphere (NUMA) on Manycore Processors Abdi, Daniel S.; Giraldo, Francis X.; Constantinescu, Emil M. arXiv https://doi.org/10.48550/arxiv.1702.04316	preprint	January 2017
Acceleration of the IMplicit–EXplicit nonhydrostatic unified model of the atmosphere on manycore processors Abdi, Daniel S.; Giraldo, Francis X.; Constantinescu, Emil M. The International Journal of High Performance Computing Applications, Vol. 33, Issue 2 https://doi.org/10.1177/1094342017732395	journal	October 2017

Similar Records

The spectral element method for the shallow water equations on the sphere

Journal Article · Tue Dec 31 23:00:00 EST 1996 · Journal of Computational Physics · OSTI ID:518379

Time Acceleration Methods for Advection on the Cubed Sphere

Conference · Wed Dec 31 23:00:00 EST 2008 · OSTI ID:964701

Related Subjects

54 ENVIRONMENTAL SCIENCES
97 MATHEMATICS AND COMPUTING
GPU
Implicit Timestepping
Trilinos

Accelerating Time Integration for the Shallow Water Equations on the Sphere Using GPUs

Citation Formats

References (22)

Cited By (2)

Similar Records

Related Subjects