TRITON: A Multi-GPU open source 2D hydrodynamic flood model
Abstract
A new open source multi-GPU 2D flood model called TRITON is presented in this work. The model solves the 2D shallow water equations with source terms using a time-explicit first order upwind scheme based on an Augmented Roe's solver that incorporates a careful estimation of bed strengths and a local implicit formulation of friction terms. Here, the scheme is demonstrated to be first order accurate, robust and able to solve for flows under various conditions. TRITON is implemented such that the model effectively utilizes heterogeneous architectures, from single to multiple CPUs and GPUs. Different test cases are shown to illustrate the capabilities and performance of the model, showing promising runtimes for large spatial and temporal scales when leveraging the computer power of GPUs. Under this hardware configuration, communication and input/output subroutines may impact the scalability. The code is developed under an open source license and can be freely downloaded in https://code.ornl.gov/hydro/triton.
- Authors:
-
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Tennessee Technological Univ., Cookeville, TN (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Publication Date:
- Research Org.:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1783054
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Environmental Modelling and Software
- Additional Journal Information:
- Journal Volume: 141; Journal ID: ISSN 1364-8152
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; 2D flood model; Open source; Multi-GPU; High-resolution; Shallow water equations
Citation Formats
Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., and Evans, Katherine J. TRITON: A Multi-GPU open source 2D hydrodynamic flood model. United States: N. p., 2021.
Web. doi:10.1016/j.envsoft.2021.105034.
Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., & Evans, Katherine J. TRITON: A Multi-GPU open source 2D hydrodynamic flood model. United States. https://doi.org/10.1016/j.envsoft.2021.105034
Morales-Hernández, Mario, Sharif, Md Bulbul, Kalyanapu, A., Ghafoor, Sheikh K., Dullo, Tigstu T., Gangrade, Sudershan, Kao, Shih-Chieh, Norman, Matthew R., and Evans, Katherine J. Fri .
"TRITON: A Multi-GPU open source 2D hydrodynamic flood model". United States. https://doi.org/10.1016/j.envsoft.2021.105034. https://www.osti.gov/servlets/purl/1783054.
@article{osti_1783054,
title = {TRITON: A Multi-GPU open source 2D hydrodynamic flood model},
author = {Morales-Hernández, Mario and Sharif, Md Bulbul and Kalyanapu, A. and Ghafoor, Sheikh K. and Dullo, Tigstu T. and Gangrade, Sudershan and Kao, Shih-Chieh and Norman, Matthew R. and Evans, Katherine J.},
abstractNote = {A new open source multi-GPU 2D flood model called TRITON is presented in this work. The model solves the 2D shallow water equations with source terms using a time-explicit first order upwind scheme based on an Augmented Roe's solver that incorporates a careful estimation of bed strengths and a local implicit formulation of friction terms. Here, the scheme is demonstrated to be first order accurate, robust and able to solve for flows under various conditions. TRITON is implemented such that the model effectively utilizes heterogeneous architectures, from single to multiple CPUs and GPUs. Different test cases are shown to illustrate the capabilities and performance of the model, showing promising runtimes for large spatial and temporal scales when leveraging the computer power of GPUs. Under this hardware configuration, communication and input/output subroutines may impact the scalability. The code is developed under an open source license and can be freely downloaded in https://code.ornl.gov/hydro/triton.},
doi = {10.1016/j.envsoft.2021.105034},
journal = {Environmental Modelling and Software},
number = ,
volume = 141,
place = {United States},
year = {Fri Apr 02 00:00:00 EDT 2021},
month = {Fri Apr 02 00:00:00 EDT 2021}
}
Works referenced in this record:
The Disaster-Knowledge Matrix – Reframing and evaluating the knowledge challenges in disaster risk reduction
journal, September 2015
- Spiekermann, Raphael; Kienberger, Stefan; Norton, John
- International Journal of Disaster Risk Reduction, Vol. 13
A simple hydrologically based model of land surface water and energy fluxes for general circulation models
journal, January 1994
- Liang, Xu; Lettenmaier, Dennis P.; Wood, Eric F.
- Journal of Geophysical Research, Vol. 99, Issue D7
A simple inertial formulation of the shallow water equations for efficient two-dimensional flood inundation modelling
journal, June 2010
- Bates, Paul D.; Horritt, Matthew S.; Fewtrell, Timothy J.
- Journal of Hydrology, Vol. 387, Issue 1-2
An efficient GPU implementation for a faster simulation of unsteady bed-load transport
journal, March 2016
- Juez, Carmelo; Lacasta, Asier; Murillo, Javier
- Journal of Hydraulic Research, Vol. 54, Issue 3
A subgrid channel model for simulating river hydraulics and floodplain inundation over large and data sparse areas: FLOODPLAIN INUNDATION OVER LARGE AREAS
journal, November 2012
- Neal, Jeffrey; Schumann, Guy; Bates, Paul
- Water Resources Research, Vol. 48, Issue 11
A full-scale fluvial flood modelling framework based on a high-performance integrated hydrodynamic modelling system (HiPIMS)
journal, October 2019
- Xia, Xilin; Liang, Qiuhua; Ming, Xiaodong
- Advances in Water Resources, Vol. 132
Flux Difference Splitting and the Balancing of Source Terms and Flux Gradients
journal, November 2000
- Hubbard, M. E.; Garcia-Navarro, P.
- Journal of Computational Physics, Vol. 165, Issue 1
Internal boundary conditions for a GPU-accelerated 2D shallow water model: Implementation and applications
journal, March 2020
- Dazzi, Susanna; Vacondio, Renato; Mignosa, Paolo
- Advances in Water Resources, Vol. 137
Estimates of present and future flood risk in the conterminous United States
journal, February 2018
- Wing, Oliver E. J.; Bates, Paul D.; Smith, Andrew M.
- Environmental Research Letters, Vol. 13, Issue 3
IberWQ: A GPU Accelerated Tool for 2D Water Quality Modeling in Rivers and Estuaries
journal, February 2020
- García-Feal, Orlando; Cea, Luis; González-Cao, José
- Water, Vol. 12, Issue 2
An efficient solution for hazardous geophysical flows simulation using GPUs
journal, May 2015
- Lacasta, A.; Juez, C.; Murillo, J.
- Computers & Geosciences, Vol. 78
A comprehensive explanation and exercise of the source terms in hyperbolic systems using Roe type solutions. Application to the 1D-2D shallow water equations
journal, December 2016
- Murillo, J.; Navas-Montilla, A.
- Advances in Water Resources, Vol. 98
The GeoClaw software for depth-averaged flows with adaptive refinement
journal, September 2011
- Berger, Marsha J.; George, David L.; LeVeque, Randall J.
- Advances in Water Resources, Vol. 34, Issue 9
Validation of a 30 m resolution flood hazard model of the conterminous United States: 30 m RESOLUTION FLOOD MODEL OF CONUS
journal, September 2017
- Wing, Oliver E. J.; Bates, Paul D.; Sampson, Christopher C.
- Water Resources Research, Vol. 53, Issue 9
Integration of a shallow water model with a local time step
journal, July 2008
- Sanders, Brett F.
- Journal of Hydraulic Research, Vol. 46, Issue 4
An integrated assessment of urban flooding mitigation strategies for robust decision making
journal, September 2017
- Xie, Jiaqiang; Chen, Hao; Liao, Zhenliang
- Environmental Modelling & Software, Vol. 95
An optimized GPU implementation of a 2D free surface simulation model on unstructured meshes
journal, December 2014
- Lacasta, A.; Morales-Hernández, M.; Murillo, J.
- Advances in Engineering Software, Vol. 78
A GPU-Accelerated Shallow-Water Scheme for Surface Runoff Simulations
journal, February 2020
- Aureli, Francesca; Prost, Federico; Vacondio, Renato
- Water, Vol. 12, Issue 3
Weak solutions for partial differential equations with source terms: Application to the shallow water equations
journal, June 2010
- Murillo, J.; García-Navarro, P.
- Journal of Computational Physics, Vol. 229, Issue 11
High-performance computing in water resources hydrodynamics
journal, March 2020
- Morales-Hernández, M.; Sharif, M. B.; Gangrade, S.
- Journal of Hydroinformatics
Flood risk management in sponge cities: The role of integrated simulation and 3D visualization
journal, October 2019
- Wang, Chen; Hou, Jingming; Miller, David
- International Journal of Disaster Risk Reduction, Vol. 39
2D numerical simulation of unsteady flows for large scale floods prediction in real time
journal, December 2019
- Echeverribar, I.; Morales-Hernández, M.; Brufau, P.
- Advances in Water Resources, Vol. 134
Wave Riemann description of friction terms in unsteady shallow flows: Application to water and mud/debris floods
journal, February 2012
- Murillo, J.; García-Navarro, P.
- Journal of Computational Physics, Vol. 231, Issue 4
OpenMP and CUDA simulations of Sella Zerbino Dam break on unstructured grids
journal, June 2016
- Petaccia, G.; Leporati, F.; Torti, E.
- Computational Geosciences, Vol. 20, Issue 5
A new efficient implicit scheme for discretising the stiff friction terms in the shallow water equations
journal, July 2018
- Xia, Xilin; Liang, Qiuhua
- Advances in Water Resources, Vol. 117
An Accelerated Tool for Flood Modelling Based on Iber
journal, October 2018
- García-Feal, Orlando; González-Cao, José; Gómez-Gesteira, Moncho
- Water, Vol. 10, Issue 10
ParBreZo: A parallel, unstructured grid, Godunov-type, shallow-water code for high-resolution flood inundation modeling at the regional scale
journal, December 2010
- Sanders, Brett F.; Schubert, Jochen E.; Detwiler, Russell L.
- Advances in Water Resources, Vol. 33, Issue 12
Integration of a Levee Breach Erosion Model in a GPU‐Accelerated 2D Shallow Water Equations Code
journal, January 2019
- Dazzi, S.; Vacondio, R.; Mignosa, P.
- Water Resources Research, Vol. 55, Issue 1
SWASHES: a compilation of shallow water analytic solutions for hydraulic and environmental studies: ANALYTIC SOLUTIONS FOR SHALLOW WATER EQUATIONS
journal, October 2012
- Delestre, Olivier; Lucas, Carine; Ksinant, Pierre-Antoine
- International Journal for Numerical Methods in Fluids, Vol. 72, Issue 3
A comparison of three parallelisation methods for 2D flood inundation models
journal, April 2010
- Neal, Jeffrey C.; Fewtrell, Timothy J.; Bates, Paul D.
- Environmental Modelling & Software, Vol. 25, Issue 4
Ensemble-based flood vulnerability assessment for probable maximum flood in a changing environment
journal, September 2019
- Gangrade, Sudershan; Kao, Shih-Chieh; Dullo, Tigstu T.
- Journal of Hydrology, Vol. 576
GPU implementation of the 2D shallow water equations for the simulation of rainfall/runoff events
journal, March 2015
- Lacasta, Asier; Morales-Hernández, Mario; Murillo, Javier
- Environmental Earth Sciences, Vol. 74, Issue 11
A local time stepping algorithm for GPU-accelerated 2D shallow water models
journal, January 2018
- Dazzi, Susanna; Vacondio, Renato; Dal Palù, Alessandro
- Advances in Water Resources, Vol. 111
Assessment of GPU computational enhancement to a 2D flood model
journal, August 2011
- Kalyanapu, Alfred J.; Shankar, Siddharth; Pardyjak, Eric R.
- Environmental Modelling & Software, Vol. 26, Issue 8
PRIMo: Parallel raster inundation model
journal, April 2019
- Sanders, Brett F.; Schubert, Jochen E.
- Advances in Water Resources, Vol. 126
Review of trend analysis and climate change projections of extreme precipitation and floods in Europe
journal, November 2014
- Madsen, H.; Lawrence, D.; Lang, M.
- Journal of Hydrology, Vol. 519
Probabilistic Flood Maps to support decision‐making: Mapping the Value of Information
journal, February 2016
- Alfonso, L.; Mukolwe, M. M.; Di Baldassarre, G.
- Water Resources Research, Vol. 52, Issue 2
Participatory modelling for stakeholder involvement in the development of flood risk management intervention options
journal, August 2016
- Maskrey, Shaun A.; Mount, Nick J.; Thorne, Colin R.
- Environmental Modelling & Software, Vol. 82
Two-Dimensional Numerical Simulation of Bed-Load Transport of a Finite-Depth Sediment Layer: Applications to Channel Flushing
journal, September 2017
- Caviedes-Voullième, Daniel; Morales-Hernández, Mario; Juez, Carmelo
- Journal of Hydraulic Engineering, Vol. 143, Issue 9
A multi-GPU shallow-water simulation with transport of contaminants: A MULTI-GPU SHALLOW-WATER SIMULATION
journal, August 2012
- Viñas, M.; Lobeiras, J.; Fraguela, B. B.
- Concurrency and Computation: Practice and Experience, Vol. 25, Issue 8
GPU computing for shallow water flow simulation based on finite volume schemes
journal, February 2011
- Castro, Manuel J.; Ortega, Sergio; de la Asunción, Marc
- Comptes Rendus Mécanique, Vol. 339, Issue 2-3
Collaborative Modeling With Fine‐Resolution Data Enhances Flood Awareness, Minimizes Differences in Flood Perception, and Produces Actionable Flood Maps
journal, January 2020
- Sanders, Brett F.; Schubert, Jochen E.; Goodrich, Kristen A.
- Earth's Future, Vol. 8, Issue 1
Efficient GPU implementation of a two waves TVD-WAF method for the two-dimensional one layer shallow water system on structured meshes
journal, July 2013
- de la Asunción, Marc; Castro, Manuel J.; Fernández-Nieto, E. D.
- Computers & Fluids, Vol. 80
The shallow water equations and their application to realistic cases
journal, January 2019
- García-Navarro, P.; Murillo, J.; Fernández-Pato, J.
- Environmental Fluid Mechanics, Vol. 19, Issue 5
A General Design for a Scalable MPI-GPU Multi-Resolution 2D Numerical Solver
journal, May 2020
- Turchetto, Massimiliano; Palu, Alessandro Dal; Vacondio, Renato
- IEEE Transactions on Parallel and Distributed Systems, Vol. 31, Issue 5
GPU-enhanced Finite Volume Shallow Water solver for fast flood simulations
journal, July 2014
- Vacondio, R.; Dal Palù, A.; Mignosa, P.
- Environmental Modelling & Software, Vol. 57
A CyberGIS Integration and Computation Framework for High-Resolution Continental-Scale Flood Inundation Mapping
journal, June 2018
- Liu, Yan Y.; Maidment, David R.; Tarboton, David G.
- JAWRA Journal of the American Water Resources Association, Vol. 54, Issue 4
Simulation of Hurricane Harvey flood event through coupled hydrologic‐hydraulic models: Challenges and next steps
journal, March 2021
- Dullo, Tigstu T.; Gangrade, Sudershan; Morales‐Hernández, Mario
- Journal of Flood Risk Management
Collaborative modelling for active involvement of stakeholders in urban flood risk management
journal, January 2012
- Evers, M.; Jonoski, A.; Maksimovič, Č.
- Natural Hazards and Earth System Sciences, Vol. 12, Issue 9
A non-uniform efficient grid type for GPU-parallel Shallow Water Equations models
journal, February 2017
- Vacondio, Renato; Dal Palù, Alessandro; Ferrari, Alessia
- Environmental Modelling & Software, Vol. 88
FullSWOF: Full Shallow-Water equations for Overland Flow
journal, December 2017
- Delestre, Olivier; Darboux, Frédéric; James, François
- The Journal of Open Source Software, Vol. 2, Issue 20
Accelerating an Adaptive Mesh Refinement Code for Depth‐Averaged Flows Using GPUs
journal, August 2019
- Qin, Xinsheng; LeVeque, Randall J.; Motley, Michael R.
- Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 8
Efficient shallow water simulations on GPUs: Implementation, visualization, verification, and validation
journal, February 2012
- Brodtkorb, André R.; Sætra, Martin L.; Altinakar, Mustafa
- Computers & Fluids, Vol. 55