OpenACC acceleration for the PN–PN-2 algorithm in Nek5000

Otero, Evelyn; Gong, Jing; Min, Misun; Fischer, Paul; Schlatter, Philipp; Laure, Erwin

doi:10.1016/j.jpdc.2019.05.010

Title: OpenACC acceleration for the $P_{N} – P_{N - 2}$ algorithm in Nek5000

Full Record
Other Related Research

Abstract

Due to its high performance and throughput capabilities, GPU-accelerated computing is becoming a popular technology in scientific computing, in particular using programming models such as CUDA and OpenACC. The main advantage with OpenACC is that it enables to simply port codes in their ‘‘original’’ form to GPU systems through compiler directives, thus allowing an incremental approach. An OpenACC implementation is applied to the CFD code Nek5000 for simulation of incompressible flows, based on the spectral-element method. The work follows up previous implementations and focuses now on the P_N- P_N-2 method for the spatial discretization of the Navier–Stokes equations. Performance results of the ported code show a speed-up of up to 3.1 on multi-GPU for a polynomial order N > 11.

Authors:

Otero, Evelyn ^[1]; Gong, Jing ^[1]; Min, Misun ^[2]; Fischer, Paul ^[2]; Schlatter, Philipp ^[1]; Laure, Erwin ^[1]

KTH Royal Inst. of Technology, Stockholm (Sweden)
Argonne National Lab. (ANL), Argonne, IL (United States)

Publication Date:: 2019-05-29

Research Org.:: Argonne National Lab. (ANL), Argonne, IL (United States)

Sponsoring Org.:: Swedish Foundation for Strategic Research (SSF); USDOE

OSTI Identifier:: 1571263

Grant/Contract Number:: AC02-06CH11357

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Parallel and Distributed Computing

Additional Journal Information:: Journal Volume: 132; Journal Issue: C; Journal ID: ISSN 0743-7315

Publisher:: Elsevier

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; GPU programming; High performance computing; Nek5000; OpenACC; Spectral element method

Citation Formats


                    Otero, Evelyn, Gong, Jing, Min, Misun, Fischer, Paul, Schlatter, Philipp, and Laure, Erwin. OpenACC acceleration for the PN–PN-2 algorithm in Nek5000.  United States: N. p., 2019. 
Web.  https://doi.org/10.1016/j.jpdc.2019.05.010.

Copy to clipboard


                    Otero, Evelyn, Gong, Jing, Min, Misun, Fischer, Paul, Schlatter, Philipp, & Laure, Erwin. OpenACC acceleration for the PN–PN-2 algorithm in Nek5000.  United States.  https://doi.org/10.1016/j.jpdc.2019.05.010

Copy to clipboard


                    Otero, Evelyn, Gong, Jing, Min, Misun, Fischer, Paul, Schlatter, Philipp, and Laure, Erwin. Wed .  
"OpenACC acceleration for the PN–PN-2 algorithm in Nek5000".  United States.  https://doi.org/10.1016/j.jpdc.2019.05.010.  https://www.osti.gov/servlets/purl/1571263.

Copy to clipboard


                    
@article{osti_1571263,

  title        = {OpenACC acceleration for the PN–PN-2 algorithm in Nek5000},

  author       = {Otero, Evelyn and Gong, Jing and Min, Misun and Fischer, Paul and Schlatter, Philipp and Laure, Erwin},

  abstractNote = {Due to its high performance and throughput capabilities, GPU-accelerated computing is becoming a popular technology in scientific computing, in particular using programming models such as CUDA and OpenACC. The main advantage with OpenACC is that it enables to simply port codes in their ‘‘original’’ form to GPU systems through compiler directives, thus allowing an incremental approach. An OpenACC implementation is applied to the CFD code Nek5000 for simulation of incompressible flows, based on the spectral-element method. The work follows up previous implementations and focuses now on the PN- PN-2 method for the spatial discretization of the Navier–Stokes equations. Performance results of the ported code show a speed-up of up to 3.1 on multi-GPU for a polynomial order N > 11.},

  doi          = {10.1016/j.jpdc.2019.05.010},

  journal      = {Journal of Parallel and Distributed Computing},

  number       = C,

  volume       = 132,

  place        = {United States},

  year         = {2019},

  month        = {5}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1016/j.jpdc.2019.05.010

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

Nek5000 with OpenACC

Journal Article

Nek5000 is a computational fluid dynamics code based on the spectral element method used for the simulation of incompressible flows. We follow up on an earlier study which ported the simplified version of Nek5000 to a GPU-accelerated system by presenting the hybrid CPU/GPU implementation of the full Nek5000 code using OpenACC. The matrix-matrix multiplication, the Nek5000 gather-scatter operator and a preconditioned Conjugate Gradient solver have implemented using OpenACC for multi-GPU systems.We report an speed-up of 1.3 on single node of a Cray XK6 when using OpenACC directives in Nek5000. On 512 nodes of the Titan supercomputer, the speed-up can bemore »« less
https://doi.org/10.1007/978-3-319-15976-8_4
OpenACC acceleration of the Nek5000 spectral element code

Journal Article Markidis, Stefano ; Gong, Jing ; Schliephake, Michael ; ... - International Journal of High Performance Computing Applications

We present a case study of porting NekBone, a skeleton version of the Nek5000 code, to a parallel GPU-accelerated system. Nek5000 is a computational fluid dynamics code based on the spectral element method used for the simulation of incompressible flow. The original NekBone Fortran source code has been used as the base and enhanced by OpenACC directives. The profiling of NekBone provided an assessment of the suitability of the code for GPU systems, and indicated possible kernel optimizations. To port NekBone to GPU systems required little effort and a small number of additional lines of code (approximately one OpenACC directivemore »« less
https://doi.org/10.1177/1094342015576846
Nekbone performance on GPUs with OpenACC and CUDA Fortran implementations

Journal Article Gong, Jing ; Markidis, Stefano ; Laure, Erwin ; ... - Journal of Supercomputing

We present a hybrid GPU implementation and performance analysis of Nekbone, which represents one of the core kernels of the incompressible Navier–Stokes solver Nek5000. The implementation is based on OpenACC and CUDA Fortran for local parallelization of the compute-intensive matrix–matrix multiplication part, which significantly minimizes the modification of the existing CPU code while extending the simulation capability of the code to GPU architectures. Our discussion includes the GPU results of OpenACC interoperating with CUDA Fortran and the gather–scatter operations with GPUDirect communication. We demonstrate performance of up to 552 Tflops on 16, 384 GPUs of the OLCF Cray XK7 Titan.
https://doi.org/10.1007/s11227-016-1744-5
Performance of new radiation-tolerant thin planar and 3D columnar n $^{+}$ on p silicon pixel sensors up to a maximum fluence of $~ 5 \times 1 0^{15}$ n $_{eq}$ /cm $^{2}$

Journal Article Boscardin, M. ; Ceccarelli, R. ; Dalla Betta, G. F. ; ... - Nuclear Instruments and Methods in Physics Research. Section A, Accelerators, Spectrometers, Detectors and Associated Equipment

Tmore »« less
https://doi.org/10.1016/j.nima.2019.163222

Full Text Available
OpenACC acceleration of an unstructured CFD solver based on a reconstructed discontinuous Galerkin method for compressible flows

Journal Article Xia, Yidong ; Lou, Jialin ; Luo, Hong ; ... - International Journal for Numerical Methods in Fluids

Here, an OpenACC directive-based graphics processing unit (GPU) parallel scheme is presented for solving the compressible Navier–Stokes equations on 3D hybrid unstructured grids with a third-order reconstructed discontinuous Galerkin method. The developed scheme requires the minimum code intrusion and algorithm alteration for upgrading a legacy solver with the GPU computing capability at very little extra effort in programming, which leads to a unified and portable code development strategy. A face coloring algorithm is adopted to eliminate the memory contention because of the threading of internal and boundary face integrals. A number of flow problems are presented to verify the implementationmore »« less
Cited by 3
https://doi.org/10.1002/fld.4009

Full Text Available

Similar Records

Title: OpenACC acceleration for the P N – P N - 2 algorithm in Nek5000

Abstract

Citation Formats

Title: OpenACC acceleration for the $P_{N} – P_{N - 2}$ algorithm in Nek5000