skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Hands-on Performance Tuning of 3D Finite Difference Earthquake Simulation on GPU Fermi Chipset

Journal Article · · Procedia Computer Science
 [1];  [1];  [1];  [1];  [1]
  1. Univ. of California, San Diego, CA (United States)
+ Show Author Affiliations

3D simulation of earthquake ground motion is one of the most challenging computational problems in science. The emergence of graphic processing units (GPU) as an effective alternative to traditional general purpose processors has become increasingly capable in terms of accelerating scientific computing research. In this paper, we describe our experiences in porting AWP-ODC, a 3D finite difference seismic wave propagation code, to the latest GPU Fermi chipset. We completely rewrote this Fortran-based 13-point asymmetric stencil computation code in C and MPI-CUDA in order to take advantage of the powerful GPU computing capabilities. Our new CUDA code implemented the asymmetric 3D stencil on Fermi to make the best use of GPU on-chip memory for an aggressive parallel efficiency. Benchmark on NVIDIA Tesla M2090 demonstrated 10x speedup versus the original fully optimized AWP-ODC FORTRAN MPI code running on a single Intel Nehalem 2.4 GHz CPU socket (4 cores/CPU), and 15x speedup versus the same MPI code running on a single AMD Istanbul 2.6 GHz CPU socket (6 cores/CPU). Sustained single-GPU performance of 143.8 GFLOPS in single precision is benchmarked for the testing case of 128x128x960 mesh size.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
USDOE Office of Science (SC)
OSTI ID:
1567289
Journal Information:
Procedia Computer Science, Vol. 9, Issue C; ISSN 1877-0509
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 12 works
Citation information provided by
Web of Science

References (17)

Staggered-grid split-node method for spontaneous rupture simulation journal January 2007
Scalable parallel programming with CUDA conference January 2008
Workflow-Based High Performance Data Transfer and Ingestion to Support Petascale Simulations on TeraGrid conference May 2010
Porting a high-order finite-element earthquake modeling application to NVIDIA graphics cards using CUDA journal May 2009
Accelerating large-scale simulation of seismic wave propagation by multi-GPUs and three-dimensional domain decomposition journal December 2010
Strong shaking in Los Angeles expected from southern San Andreas earthquake journal January 2006
Instabilities in applying absorbing boundary conditions to high‐order seismic modeling algorithms journal May 1998
High-order finite-element seismic wave propagation modeling with MPI on a large GPU cluster journal October 2010
3D finite difference computation on GPUs using CUDA conference January 2009
Modeling the propagation of elastic waves using spectral elements on a cluster of 192 GPUs journal April 2010
High Performance Stencil Code Algorithms for GPGPUs journal January 2011
Peta-scale phase-field simulation for dendritic solidification on the TSUBAME 2.0 supercomputer
  • Shimokawabe, Takashi; Aoki, Takayuki; Takaki, Tomohiro
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063388
conference January 2011
Accuracy of finite‐difference and finite‐element modeling of the scalar and elastic wave equations journal May 1984
Fast seismic modeling and Reverse Time Migration on a GPU cluster conference June 2009
Roofline: an insightful visual performance model for multicore architectures journal April 2009
Scalable Earthquake Simulation on Petascale Supercomputers
  • Cui, Yifeng; Olsen, Kim B.; Jordan, Thomas H.
  • 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.45
conference November 2010
The spectral element method: An efficient tool to simulate the seismic response of 2D and 3D geological structures journal April 1998

Cited By (4)

Improving Performance and Energy Efficiency of Geophysics Applications on GPU Architectures book January 2019
Geometric validation of a computer simulator used in radiography education journal November 2020
Multi-GPU Implementation of a 3D Finite Difference Time Domain Earthquake Code on Heterogeneous Supercomputers journal January 2013
Towards GPU Acceleration of Phonon Computation with ShengBTE
  • Wei, Yi; You, Xin; Yang, Hailong
  • HPCAsia2020: International Conference on High Performance Computing in Asia-Pacific Region, Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region https://doi.org/10.1145/3368474.3368487
conference January 2020

Similar Records

Multi-GPU Implementation of a 3D Finite Difference Time Domain Earthquake Code on Heterogeneous Supercomputers
Journal Article · Sat Jun 01 00:00:00 EDT 2013 · Procedia Computer Science · OSTI ID:1567289
+2 more
Quantum Monte Carlo Endstation for Petascale Computing
Technical Report · Wed Mar 02 00:00:00 EST 2011 · OSTI ID:1567289
Gyrokinetic toroidal simulations on leading multi- and manycore HPC systems
Conference · Sat Jan 01 00:00:00 EST 2011 · OSTI ID:1567289
+4 more

Related Subjects

97 MATHEMATICS AND COMPUTING
42 ENGINEERING
Earthquake Simulation
3D Stencil Computation
Performance Tuning
NVIDIA GPU Fermi
CUDA