DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: TRITON: A Multi-GPU open source 2D hydrodynamic flood model

Abstract

A new open source multi-GPU 2D flood model called TRITON is presented in this work. The model solves the 2D shallow water equations with source terms using a time-explicit first order upwind scheme based on an Augmented Roe's solver that incorporates a careful estimation of bed strengths and a local implicit formulation of friction terms. Here, the scheme is demonstrated to be first order accurate, robust and able to solve for flows under various conditions. TRITON is implemented such that the model effectively utilizes heterogeneous architectures, from single to multiple CPUs and GPUs. Different test cases are shown to illustrate the capabilities and performance of the model, showing promising runtimes for large spatial and temporal scales when leveraging the computer power of GPUs. Under this hardware configuration, communication and input/output subroutines may impact the scalability. The code is developed under an open source license and can be freely downloaded in https://code.ornl.gov/hydro/triton.

Authors:
ORCiD logo [1];  [2];  [2];  [2];  [2]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [3]; ORCiD logo [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Tennessee Technological Univ., Cookeville, TN (United States)
  3. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1783054
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
Environmental Modelling and Software
Additional Journal Information:
Journal Volume: 141; Journal ID: ISSN 1364-8152
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 2D flood model; Open source; Multi-GPU; High-resolution; Shallow water equations

Citation Formats

Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., and Evans, Katherine J. TRITON: A Multi-GPU open source 2D hydrodynamic flood model. United States: N. p., 2021. Web. doi:10.1016/j.envsoft.2021.105034.
Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., & Evans, Katherine J. TRITON: A Multi-GPU open source 2D hydrodynamic flood model. United States. https://doi.org/10.1016/j.envsoft.2021.105034
Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., and Evans, Katherine J. Fri . "TRITON: A Multi-GPU open source 2D hydrodynamic flood model". United States. https://doi.org/10.1016/j.envsoft.2021.105034. https://www.osti.gov/servlets/purl/1783054.
@article{osti_1783054,
title = {TRITON: A Multi-GPU open source 2D hydrodynamic flood model},
author = {Morales-Hernández, Mario and Sharif, Md Bulbul and Kalyanapu, A. and Ghafoor, Sheikh K. and Dullo, Tigstu T. and Gangrade, Sudershan and Kao, Shih-Chieh and Norman, Matthew R. and Evans, Katherine J.},
abstractNote = {A new open source multi-GPU 2D flood model called TRITON is presented in this work. The model solves the 2D shallow water equations with source terms using a time-explicit first order upwind scheme based on an Augmented Roe's solver that incorporates a careful estimation of bed strengths and a local implicit formulation of friction terms. Here, the scheme is demonstrated to be first order accurate, robust and able to solve for flows under various conditions. TRITON is implemented such that the model effectively utilizes heterogeneous architectures, from single to multiple CPUs and GPUs. Different test cases are shown to illustrate the capabilities and performance of the model, showing promising runtimes for large spatial and temporal scales when leveraging the computer power of GPUs. Under this hardware configuration, communication and input/output subroutines may impact the scalability. The code is developed under an open source license and can be freely downloaded in https://code.ornl.gov/hydro/triton.},
doi = {10.1016/j.envsoft.2021.105034},
journal = {Environmental Modelling and Software},
number = ,
volume = 141,
place = {United States},
year = {Fri Apr 02 00:00:00 EDT 2021},
month = {Fri Apr 02 00:00:00 EDT 2021}
}

Works referenced in this record:

The Disaster-Knowledge Matrix – Reframing and evaluating the knowledge challenges in disaster risk reduction
journal, September 2015

  • Spiekermann, Raphael; Kienberger, Stefan; Norton, John
  • International Journal of Disaster Risk Reduction, Vol. 13
  • DOI: 10.1016/j.ijdrr.2015.05.002

A simple hydrologically based model of land surface water and energy fluxes for general circulation models
journal, January 1994

  • Liang, Xu; Lettenmaier, Dennis P.; Wood, Eric F.
  • Journal of Geophysical Research, Vol. 99, Issue D7
  • DOI: 10.1029/94JD00483

A simple inertial formulation of the shallow water equations for efficient two-dimensional flood inundation modelling
journal, June 2010


An efficient GPU implementation for a faster simulation of unsteady bed-load transport
journal, March 2016


A subgrid channel model for simulating river hydraulics and floodplain inundation over large and data sparse areas: FLOODPLAIN INUNDATION OVER LARGE AREAS
journal, November 2012

  • Neal, Jeffrey; Schumann, Guy; Bates, Paul
  • Water Resources Research, Vol. 48, Issue 11
  • DOI: 10.1029/2012WR012514

A full-scale fluvial flood modelling framework based on a high-performance integrated hydrodynamic modelling system (HiPIMS)
journal, October 2019


Flux Difference Splitting and the Balancing of Source Terms and Flux Gradients
journal, November 2000

  • Hubbard, M. E.; Garcia-Navarro, P.
  • Journal of Computational Physics, Vol. 165, Issue 1
  • DOI: 10.1006/jcph.2000.6603

Internal boundary conditions for a GPU-accelerated 2D shallow water model: Implementation and applications
journal, March 2020


Estimates of present and future flood risk in the conterminous United States
journal, February 2018

  • Wing, Oliver E. J.; Bates, Paul D.; Smith, Andrew M.
  • Environmental Research Letters, Vol. 13, Issue 3
  • DOI: 10.1088/1748-9326/aaac65

IberWQ: A GPU Accelerated Tool for 2D Water Quality Modeling in Rivers and Estuaries
journal, February 2020

  • García-Feal, Orlando; Cea, Luis; González-Cao, José
  • Water, Vol. 12, Issue 2
  • DOI: 10.3390/w12020413

An efficient solution for hazardous geophysical flows simulation using GPUs
journal, May 2015


The GeoClaw software for depth-averaged flows with adaptive refinement
journal, September 2011


Validation of a 30 m resolution flood hazard model of the conterminous United States: 30 m RESOLUTION FLOOD MODEL OF CONUS
journal, September 2017

  • Wing, Oliver E. J.; Bates, Paul D.; Sampson, Christopher C.
  • Water Resources Research, Vol. 53, Issue 9
  • DOI: 10.1002/2017WR020917

Integration of a shallow water model with a local time step
journal, July 2008


An integrated assessment of urban flooding mitigation strategies for robust decision making
journal, September 2017


An optimized GPU implementation of a 2D free surface simulation model on unstructured meshes
journal, December 2014


A GPU-Accelerated Shallow-Water Scheme for Surface Runoff Simulations
journal, February 2020

  • Aureli, Francesca; Prost, Federico; Vacondio, Renato
  • Water, Vol. 12, Issue 3
  • DOI: 10.3390/w12030637

Weak solutions for partial differential equations with source terms: Application to the shallow water equations
journal, June 2010


High-performance computing in water resources hydrodynamics
journal, March 2020


Flood risk management in sponge cities: The role of integrated simulation and 3D visualization
journal, October 2019


2D numerical simulation of unsteady flows for large scale floods prediction in real time
journal, December 2019


Wave Riemann description of friction terms in unsteady shallow flows: Application to water and mud/debris floods
journal, February 2012


OpenMP and CUDA simulations of Sella Zerbino Dam break on unstructured grids
journal, June 2016


A new efficient implicit scheme for discretising the stiff friction terms in the shallow water equations
journal, July 2018


An Accelerated Tool for Flood Modelling Based on Iber
journal, October 2018

  • García-Feal, Orlando; González-Cao, José; Gómez-Gesteira, Moncho
  • Water, Vol. 10, Issue 10
  • DOI: 10.3390/w10101459

ParBreZo: A parallel, unstructured grid, Godunov-type, shallow-water code for high-resolution flood inundation modeling at the regional scale
journal, December 2010


Integration of a Levee Breach Erosion Model in a GPU‐Accelerated 2D Shallow Water Equations Code
journal, January 2019

  • Dazzi, S.; Vacondio, R.; Mignosa, P.
  • Water Resources Research, Vol. 55, Issue 1
  • DOI: 10.1029/2018WR023826

SWASHES: a compilation of shallow water analytic solutions for hydraulic and environmental studies: ANALYTIC SOLUTIONS FOR SHALLOW WATER EQUATIONS
journal, October 2012

  • Delestre, Olivier; Lucas, Carine; Ksinant, Pierre-Antoine
  • International Journal for Numerical Methods in Fluids, Vol. 72, Issue 3
  • DOI: 10.1002/fld.3741

A comparison of three parallelisation methods for 2D flood inundation models
journal, April 2010


Ensemble-based flood vulnerability assessment for probable maximum flood in a changing environment
journal, September 2019


GPU implementation of the 2D shallow water equations for the simulation of rainfall/runoff events
journal, March 2015

  • Lacasta, Asier; Morales-Hernández, Mario; Murillo, Javier
  • Environmental Earth Sciences, Vol. 74, Issue 11
  • DOI: 10.1007/s12665-015-4215-z

A local time stepping algorithm for GPU-accelerated 2D shallow water models
journal, January 2018


Assessment of GPU computational enhancement to a 2D flood model
journal, August 2011

  • Kalyanapu, Alfred J.; Shankar, Siddharth; Pardyjak, Eric R.
  • Environmental Modelling & Software, Vol. 26, Issue 8
  • DOI: 10.1016/j.envsoft.2011.02.014

PRIMo: Parallel raster inundation model
journal, April 2019


Review of trend analysis and climate change projections of extreme precipitation and floods in Europe
journal, November 2014


Probabilistic Flood Maps to support decision‐making: Mapping the Value of Information
journal, February 2016

  • Alfonso, L.; Mukolwe, M. M.; Di Baldassarre, G.
  • Water Resources Research, Vol. 52, Issue 2
  • DOI: 10.1002/2015WR017378

Participatory modelling for stakeholder involvement in the development of flood risk management intervention options
journal, August 2016


Two-Dimensional Numerical Simulation of Bed-Load Transport of a Finite-Depth Sediment Layer: Applications to Channel Flushing
journal, September 2017


A multi-GPU shallow-water simulation with transport of contaminants: A MULTI-GPU SHALLOW-WATER SIMULATION
journal, August 2012

  • Viñas, M.; Lobeiras, J.; Fraguela, B. B.
  • Concurrency and Computation: Practice and Experience, Vol. 25, Issue 8
  • DOI: 10.1002/cpe.2917

GPU computing for shallow water flow simulation based on finite volume schemes
journal, February 2011

  • Castro, Manuel J.; Ortega, Sergio; de la Asunción, Marc
  • Comptes Rendus Mécanique, Vol. 339, Issue 2-3
  • DOI: 10.1016/j.crme.2010.12.004

Collaborative Modeling With Fine‐Resolution Data Enhances Flood Awareness, Minimizes Differences in Flood Perception, and Produces Actionable Flood Maps
journal, January 2020

  • Sanders, Brett F.; Schubert, Jochen E.; Goodrich, Kristen A.
  • Earth's Future, Vol. 8, Issue 1
  • DOI: 10.1029/2019EF001391

Efficient GPU implementation of a two waves TVD-WAF method for the two-dimensional one layer shallow water system on structured meshes
journal, July 2013


The shallow water equations and their application to realistic cases
journal, January 2019

  • García-Navarro, P.; Murillo, J.; Fernández-Pato, J.
  • Environmental Fluid Mechanics, Vol. 19, Issue 5
  • DOI: 10.1007/s10652-018-09657-7

A General Design for a Scalable MPI-GPU Multi-Resolution 2D Numerical Solver
journal, May 2020

  • Turchetto, Massimiliano; Palu, Alessandro Dal; Vacondio, Renato
  • IEEE Transactions on Parallel and Distributed Systems, Vol. 31, Issue 5
  • DOI: 10.1109/TPDS.2019.2961909

GPU-enhanced Finite Volume Shallow Water solver for fast flood simulations
journal, July 2014


A CyberGIS Integration and Computation Framework for High-Resolution Continental-Scale Flood Inundation Mapping
journal, June 2018

  • Liu, Yan Y.; Maidment, David R.; Tarboton, David G.
  • JAWRA Journal of the American Water Resources Association, Vol. 54, Issue 4
  • DOI: 10.1111/1752-1688.12660

Simulation of Hurricane Harvey flood event through coupled hydrologic‐hydraulic models: Challenges and next steps
journal, March 2021

  • Dullo, Tigstu T.; Gangrade, Sudershan; Morales‐Hernández, Mario
  • Journal of Flood Risk Management
  • DOI: 10.1111/jfr3.12716

Collaborative modelling for active involvement of stakeholders in urban flood risk management
journal, January 2012

  • Evers, M.; Jonoski, A.; Maksimovič, Č.
  • Natural Hazards and Earth System Sciences, Vol. 12, Issue 9
  • DOI: 10.5194/nhess-12-2821-2012

A non-uniform efficient grid type for GPU-parallel Shallow Water Equations models
journal, February 2017


FullSWOF: Full Shallow-Water equations for Overland Flow
journal, December 2017

  • Delestre, Olivier; Darboux, Frédéric; James, François
  • The Journal of Open Source Software, Vol. 2, Issue 20
  • DOI: 10.21105/joss.00448

Accelerating an Adaptive Mesh Refinement Code for Depth‐Averaged Flows Using GPUs
journal, August 2019

  • Qin, Xinsheng; LeVeque, Randall J.; Motley, Michael R.
  • Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 8
  • DOI: 10.1029/2019MS001635

Efficient shallow water simulations on GPUs: Implementation, visualization, verification, and validation
journal, February 2012