High-order finite-element seismic wave propagation modeling with MPI on a large GPU cluster
- Universite de Pau et des Pays de l'Adour, CNRS and INRIA Magique-3D, Laboratoire de Modelisation et d'Imagerie en Geosciences UMR 5212, Avenue de l'Universite, 64013 Pau Cedex (France)
- Department of Scientific Computing, Florida State University, Tallahassee 32306 (United States)
- Institut fuer Angewandte Mathematik, TU Dortmund (Germany)
We implement a high-order finite-element application, which performs the numerical simulation of seismic wave propagation resulting for instance from earthquakes at the scale of a continent or from active seismic acquisition experiments in the oil industry, on a large cluster of NVIDIA Tesla graphics cards using the CUDA programming environment and non-blocking message passing based on MPI. Contrary to many finite-element implementations, ours is implemented successfully in single precision, maximizing the performance of current generation GPUs. We discuss the implementation and optimization of the code and compare it to an existing very optimized implementation in C language and MPI on a classical cluster of CPU nodes. We use mesh coloring to efficiently handle summation operations over degrees of freedom on an unstructured mesh, and non-blocking MPI messages in order to overlap the communications across the network and the data transfer to and from the device via PCIe with calculations on the GPU. We perform a number of numerical tests to validate the single-precision CUDA and MPI implementation and assess its accuracy. We then analyze performance measurements and depending on how the problem is mapped to the reference CPU cluster, we obtain a speedup of 20x or 12x.
- OSTI ID:
- 21418106
- Journal Information:
- Journal of Computational Physics, Vol. 229, Issue 20; Other Information: DOI: 10.1016/j.jcp.2010.06.024; PII: S0021-9991(10)00339-6; Copyright (c) 2010 Elsevier Science B.V., Amsterdam, The Netherlands, All rights reserved.; ISSN 0021-9991
- Country of Publication:
- United States
- Language:
- English
Similar Records
Hands-on Performance Tuning of 3D Finite Difference Earthquake Simulation on GPU Fermi Chipset
Quantum Monte Carlo Endstation for Petascale Computing