Designing a graphics processing unit accelerated petaflop capable lattice Boltzmann solver: Read aligned data layouts and asynchronous communication
- Åbo Akademi University, Faculty of Science and Engineering, Åbo, Finland
- Department of Physics and Nanoscience Center, University of Jyväskylä, Jyväskylä, Finland; Department of Physics, Tampere University of Technology, Tampere, Finland
The lattice Boltzmann method is a well-established numerical approach for complex fluid flow simulations. Recently, general-purpose graphics processing units (GPUs) have become available as high-performance computing resources at large scale. We report on designing and implementing a lattice Boltzmann solver for multi-GPU systems that achieves 1.79 PFLOPS performance on 16,384 GPUs. To achieve this performance, we introduce a GPU compatible version of the so-called bundle data layout and eliminate the halo sites in order to improve data access alignment. Furthermore, we make use of the possibility to overlap data transfer between the host central processing unit and the device GPU with computing on the GPU. As a benchmark case, we simulate flow in porous media and measure both strong and weak scaling performance with the emphasis being on large-scale simulations using realistic input data.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- 287703
- OSTI ID:
- 1565624
- Journal Information:
- International Journal of High Performance Computing Applications, Vol. 31, Issue 3; ISSN 1094-3420
- Publisher:
- SAGE
- Country of Publication:
- United States
- Language:
- English
Similar Records
Developing extensible lattice-Boltzmann simulators for general-purpose graphics-processing units
A prospect for computing in porous materials research: Very large fluid flow simulations