Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

A Scalable Semi-Implicit Barotropic Mode Solver for the MPAS-Ocean

Journal Article · · Journal of Advances in Modeling Earth Systems
DOI:https://doi.org/10.1029/2020ms002238· OSTI ID:1782059
 [1];  [1];  [2];  [2];  [3]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  3. Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Florida State Univ., Tallahassee, FL (United States)
+ Show Author Affiliations
A scalable semi-implicit barotropic mode solver for the ocean component of the model for prediction across scales has been implemented as a competitor to an existing explicit-subcycling scheme to allow faster and more stable simulations while not sacrificing accuracy. The semi-implicit solver adopts the pipelined preconditioned bi-conjugate gradient stabilization algorithm as an iterative solver in conjunction with the restricted additive Schwarz preconditioner that accelerates the convergence rate of the iterative solver. The preconditioner is constructed from a linearized barotropic system that also reorders the system for optimal performance, while the semi-implicit solver deals with the fully nonlinear barotropic system that requires reassembly of the coefficient matrix for every time step. Several numerical experiments, from simple one-dimensional tests to three-dimensional real-world tests, demonstrate that the semi-implicit solver has almost the same accuracy and better parallel scalability compared with the existing scheme while allowing faster and more stable simulations. Furthermore, the semi-implicit solver accelerates the barotropic mode up to 2.9 times faster than the existing scheme on 16,320 processors, leading to an overall runtime speedup of 1.9.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
89233218CNA000001; AC05-00OR22725
OSTI ID:
1782059
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 4 Vol. 13; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (62)

Barotropic-Baroclinic Time Splitting for Ocean Circulation Modeling journal July 1997
A Two-Level Time-Stepping Method for Layered Ocean Circulation Models journal March 2002
North Pacific decadal variability in the CMIP5 last millennium simulations journal February 2016
Damping of Crank–Nicolson error oscillations journal July 2003
A note on stability of pseudospectral methods for wave propagation journal June 2002
Developments in ocean climate modelling journal January 2000
A three-dimensional hydrostatic model for coastal and ocean modelling using a generalised topography following co-ordinate system journal January 2002
Parallel Domain-decomposed Taiwan Multi-scale Community Ocean Model (PD-TIMCOM) journal June 2011
A two-level time-stepping method for layered ocean circulation models: further development and testing journal July 2005
Stability analysis of split-explicit free surface ocean models: Implication of the depth-independent barotropic mode approximation journal December 2019
Finding, analysing and solving MPI communication bottlenecks in Earth System models journal September 2019
Chebyshev pseudospectral method for wave equation with absorbing boundary conditions that does not use a first order hyperbolic system journal July 2010
Rescaled height coordinates for accurate representation of free-surface flows in ocean circulation models journal January 2004
The regional oceanic modeling system (ROMS): a split-explicit, free-surface, topography-following-coordinate oceanic model journal January 2005
An unstructured-grid, finite-volume, nonhydrostatic, parallel coastal ocean simulator journal January 2006
Energy conservation issues in sigma-coordinate free-surface ocean models journal January 2008
A comparison of two formulations of barotropic–baroclinic splitting for layered models of ocean circulation journal January 2008
Reconciling estimates of the free surface height in Lagrangian vertical coordinate ocean models with mode-split time stepping journal January 2009
A multi-resolution approach to global ocean modeling journal September 2013
Evaluation of the arbitrary Lagrangian–Eulerian vertical coordinate method in the MPAS-Ocean model journal February 2015
A study of overflow simulations using MPAS-Ocean: Vertical grids, resolution, and viscosity journal December 2015
The numerics of hydrostatic structured-grid coastal ocean models: State of the art and future perspectives journal May 2018
Hiding global synchronization latency in the preconditioned Conjugate Gradient algorithm journal July 2014
Numerical reproducibility for the parallel reduction on multi- and many-core architectures journal November 2015
The communication-hiding pipelined BiCGstab method for the parallel solution of large unsymmetric linear systems journal July 2017
Towards Characterizing the Variability of Statistically Consistent Community Earth System Model Simulations journal January 2016
A mechanism for generating ENSO decadal variability journal June 1999
A method for computing horizontal pressure-gradient force in an oceanic model with a nonaligned vertical coordinate journal January 2003
An Evaluation of the Ocean and Sea Ice Climate of E3SM Using MPAS and Interannual CORE‐II Forcing journal May 2019
The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution journal July 2019
MPAS‐Ocean Simulation Quality for Variable‐Resolution North American Coastal Meshes journal March 2020
The Community Earth System Model Version 2 (CESM2) journal February 2020
A Primer on the Vertical Lagrangian‐Remap Method in Ocean Models Based on Finite Volume Generalized Vertical Coordinates journal October 2020
Implicit free-surface method for the Bryan-Cox-Semtner ocean model journal January 1994
A minimum overlap restricted additive Schwarz preconditioner and applications in 3D flow simulations book January 1998
On the Reproducibility of MPI Reduction Operations
  • Balaji, Pavan; Kimpe, Dries
  • 2013 IEEE International Conference on High Performance Computing and Communications (HPCC) & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (EUC), 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing https://doi.org/10.1109/HPCC.and.EUC.2013.65
conference November 2013
Enhancing regional ocean modeling simulation performance with the Xeon Phi architecture conference June 2017
Finite Difference Methods for Ordinary and Partial Differential Equations book January 2007
Iterative Methods for Linear and Nonlinear Equations book January 1995
Hiding Global Communication Latency in the GMRES Algorithm on Massively Parallel Machines journal January 2013
A Restricted Additive Schwarz Preconditioner for General Sparse Linear Systems journal January 1999
Performance of the community earth system model
  • Worley, Patrick H.; Mirin, Arthur A.; Craig, Anthony P.
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063457
conference January 2011
Improving the scalability of the ocean barotropic solver in the community earth system model
  • Hu, Yong; Huang, Xiaomeng; Baker, Allison H.
  • SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/2807591.2807596
conference November 2015
Model Assessment of Decadal Variability and Trends in the Tropical Pacific Ocean journal September 1998
Numerical Simulation of Flow around a Tall Isolated Seamount. Part I: Problem Formulation and Model Accuracy journal August 1993
Stability of the Semi-Implicit Method of Time Integration journal March 1978
An Efficient Semi-Lagrangian and Alternating Direction Implicit Method for Integrating the Shallow Water Equations journal October 1984
U.K. HiGEM: The New U.K. High-Resolution Global Environment Model—Model Description and Basic Evaluation journal April 2009
Advancing Dynamical Cores of Oceanic Models across All Scales journal March 2019
Pacific Mean-State Control of Atlantic Multidecadal Oscillation–El Niño Relationship journal May 2020
Controlling the Computational Modes of the Arbitrarily Structured C Grid journal October 2012
A Numerical Method Based on Leapfrog and a Fourth-Order Implicit Time Filter journal June 2014
CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model journal November 2011
Ongoing solution reproducibility of earth system models as they progress toward exascale computing journal January 2019
MPAS-Ocean Model User's Guide Version 6.0 report April 2018
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0) journal January 2017
The Finite-volumE Sea ice–Ocean Model (FESOM2) journal January 2017
On the numerical stability of surface–atmosphere coupling in weather and climate models journal January 2017
FESOM-C v.2: coastal dynamics on hybrid unstructured meshes journal January 2019
Scalability and some optimization of the Finite-volumE Sea ice–Ocean Model, Version 2.0 (FESOM2) journal January 2019
A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0) journal January 2015
P-CSI v1.0, an accelerated barotropic solver for the high-resolution ocean model component in the Community Earth System Model v2.0 journal January 2016

Similar Records

An implicit barotropic mode solver for MPAS-ocean using a modern Fortran solver interface
Journal Article · Fri Nov 17 19:00:00 EST 2023 · International Journal of High Performance Computing Applications · OSTI ID:2251644
Towards an adaptive `semi-implicit` solution scheme for nonlinear structural dynamic problems
Journal Article · Mon Aug 01 00:00:00 EDT 1994 · Computers and Structures · OSTI ID:135314
A fast implicit solver for semiconductor models in one space dimension
Journal Article · Mon May 18 20:00:00 EDT 2020 · Journal of Computational Physics · OSTI ID:1820881

Related Subjects

97 MATHEMATICS AND COMPUTING
barotropic mode
implicit solver
ocean modeling
performance