Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Desai, Swapnil; Kim, Yu Jeong; Song, Wonsik; Luong, Minh Bau; Hernández Pérez, Francisco E.; Sankaran, Ramanan; Im, Hong G.

doi:10.1016/j.compfluid.2020.104787

Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Journal Article · Mon Nov 30 00:00:00 EST 2020 · Computers and Fluids

DOI:https://doi.org/10.1016/j.compfluid.2020.104787· OSTI ID:1747022

Desai, Swapnil ^[1]; Kim, Yu Jeong ^[2]; Song, Wonsik ^[2]; Luong, Minh Bau ^[2]; Hernández Pérez, Francisco E. ^[2]; ^[3]; Im, Hong G. ^[2]

Univ. of Tennessee, Knoxville, TN (United States)
King Abdullah Univ. of Science and Technology (KAUST), Thuwal (Saudi Arabia)
Univ. of Tennessee, Knoxville, TN (United States); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. Furthermore, the performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE; USDOE Office of Science (SC)

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1747022

Alternate ID(s):: OSTI ID: 1810984

Journal Information:: Computers and Fluids, Journal Name: Computers and Fluids Journal Issue: 1 Vol. 215; ISSN 0045-7930

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (60)

Thermal decomposition reaction and a comprehensive kinetic model of dimethyl ether Zhao, Zhenwei; Chaos, Marcos; Kazakov, Andrei International Journal of Chemical Kinetics, Vol. 40, Issue 1 https://doi.org/10.1002/kin.20285	journal	January 2008
Comprehensive H2/O2 kinetic model for high-pressure combustion Burke, Michael P.; Chaos, Marcos; Ju, Yiguang International Journal of Chemical Kinetics, Vol. 44, Issue 7 https://doi.org/10.1002/kin.20603	journal	December 2011
Weighted Essentially Non-oscillatory Schemes Liu, Xu-Dong; Osher, Stanley; Chan, Tony Journal of Computational Physics, Vol. 115, Issue 1 https://doi.org/10.1006/jcph.1994.1187	journal	November 1994
Efficient Implementation of Weighted ENO Schemes Jiang, Guang-Shan; Shu, Chi-Wang Journal of Computational Physics, Vol. 126, Issue 1 https://doi.org/10.1006/jcph.1996.0130	journal	June 1996
Effects of Turbulence and Temperature Fluctuations on Knock Development in an Ethanol/Air Mixture Luong, Minh Bau; Desai, Swapnil; Hernández Pérez, Francisco E. Flow, Turbulence and Combustion, Vol. 106, Issue 2 https://doi.org/10.1007/s10494-020-00171-9	journal	May 2020
Recent progress and challenges in exploiting graphics processors in computational fluid dynamics Niemeyer, Kyle E.; Sung, Chih-Jen The Journal of Supercomputing, Vol. 67, Issue 2 https://doi.org/10.1007/s11227-013-1015-7	journal	September 2013
A survey of several finite difference methods for systems of nonlinear hyperbolic conservation laws Sod, Gary A. Journal of Computational Physics, Vol. 27, Issue 1 https://doi.org/10.1016/0021-9991(78)90023-2	journal	April 1978
Boundary conditions for direct simulations of compressible viscous flows Poinsot, T. J.; Lelef, S. K. Journal of Computational Physics, Vol. 101, Issue 1 https://doi.org/10.1016/0021-9991(92)90046-2	journal	July 1992
Several new numerical methods for compressible shear-layer simulations Kennedy, Christopher A.; Carpenter, Mark H. Applied Numerical Mathematics, Vol. 14, Issue 4 https://doi.org/10.1016/0168-9274(94)00004-2	journal	June 1994
A comprehensive modeling study of iso-octane oxidation Curran, H. Combustion and Flame, Vol. 129, Issue 3 https://doi.org/10.1016/S0010-2180(01)00373-X	journal	May 2002
Low-storage, explicit Runge–Kutta schemes for the compressible Navier–Stokes equations Kennedy, Christopher A.; Carpenter, Mark H.; Lewis, R. Michael Applied Numerical Mathematics, Vol. 35, Issue 3 https://doi.org/10.1016/S0168-9274(99)00141-5	journal	November 2000
A comprehensive detailed chemical kinetic reaction mechanism for combustion of n-alkane hydrocarbons from n-octane to n-hexadecane Westbrook, Charles K.; Pitz, William J.; Herbinet, Olivier Combustion and Flame, Vol. 156, Issue 1 https://doi.org/10.1016/j.combustflame.2008.07.014	journal	January 2009
Redesigning combustion modeling algorithms for the Graphics Processing Unit (GPU): Chemical kinetic rate evaluation and ordinary differential equation integration Shi, Yu; Green, William H.; Wong, Hsi-Wu Combustion and Flame, Vol. 158, Issue 5 https://doi.org/10.1016/j.combustflame.2011.01.024	journal	May 2011
Autoignition and front propagation in low temperature combustion engine environments Bansal, Gaurav; Im, Hong G. Combustion and Flame, Vol. 158, Issue 11 https://doi.org/10.1016/j.combustflame.2011.03.019	journal	November 2011
Comprehensive chemical kinetic modeling of the oxidation of 2-methylalkanes from C7 to C20 Sarathy, S. M.; Westbrook, C. K.; Mehl, M. Combustion and Flame, Vol. 158, Issue 12 https://doi.org/10.1016/j.combustflame.2011.05.007	journal	December 2011
Experimental analysis of propagation regimes during the autoignition of a fully premixed methane–air mixture in the presence of temperature inhomogeneities Strozzi, Camille; Mura, Arnaud; Sotton, Julien Combustion and Flame, Vol. 159, Issue 11 https://doi.org/10.1016/j.combustflame.2012.06.011	journal	November 2012
Direct numerical simulations of the ignition of lean primary reference fuel/air mixtures with temperature inhomogeneities Luong, Minh Bau; Luo, Zhaoyu; Lu, Tianfeng Combustion and Flame, Vol. 160, Issue 10 https://doi.org/10.1016/j.combustflame.2013.04.012	journal	October 2013
Direct numerical simulations of HCCI/SACI with ethanol Bhagatwala, Ankit; Chen, Jacqueline H.; Lu, Tianfeng Combustion and Flame, Vol. 161, Issue 7 https://doi.org/10.1016/j.combustflame.2013.12.027	journal	July 2014
An experimental study of flame and autoignition interactions of iso-octane and air mixtures Assanis, Dimitris; Wagnon, Scott W.; Wooldridge, Margaret S. Combustion and Flame, Vol. 162, Issue 4 https://doi.org/10.1016/j.combustflame.2014.10.012	journal	April 2015
Numerical investigation of spontaneous flame propagation under RCCI conditions Bhagatwala, Ankit; Sankaran, Ramanan; Kokjohn, Sage Combustion and Flame, Vol. 162, Issue 9 https://doi.org/10.1016/j.combustflame.2015.06.005	journal	September 2015
Direct numerical simulations of ignition of a lean n-heptane/air mixture with temperature and composition inhomogeneities relevant to HCCI and SCCI combustion Luong, Minh Bau; Yu, Gwang Hyeon; Lu, Tianfeng Combustion and Flame, Vol. 162, Issue 12 https://doi.org/10.1016/j.combustflame.2015.09.015	journal	December 2015
On the effect of injection timing on the ignition of lean PRF/air/EGR mixtures under direct dual fuel stratification conditions Luong, Minh Bau; Sankaran, Ramanan; Yu, Gwang Hyeon Combustion and Flame, Vol. 183 https://doi.org/10.1016/j.combustflame.2017.05.023	journal	September 2017
Ignition characteristics of a temporally evolving n-heptane jet in an iso-octane/air stream under RCCI combustion-relevant conditions Yu, Gwang Hyeon; Luong, Minh Bau; Chung, Suk Ho Combustion and Flame, Vol. 208 https://doi.org/10.1016/j.combustflame.2019.07.011	journal	October 2019
Auto-ignitive deflagration speed of methane (CH4) blended dimethyl-ether (DME)/air mixtures at stratified conditions Desai, Swapnil; Sankaran, Ramanan; Im, Hong G. Combustion and Flame, Vol. 211 https://doi.org/10.1016/j.combustflame.2019.10.001	journal	January 2020
Prediction of ignition modes of NTC-fuel/air mixtures with temperature and concentration fluctuations Luong, Minh Bau; Hernández Pérez, Francisco E.; Im, Hong G. Combustion and Flame, Vol. 213 https://doi.org/10.1016/j.combustflame.2019.12.002	journal	March 2020
Comparison of improved finite-difference WENO schemes for the implicit large eddy simulation of turbulent non-reacting and reacting high-speed shear flows Zhao, S.; Lardjane, N.; Fedioun, I. Computers & Fluids, Vol. 95 https://doi.org/10.1016/j.compfluid.2014.02.017	journal	May 2014
Evaluation of Riemann flux solvers for WENO reconstruction schemes: Kelvin–Helmholtz instability San, Omer; Kara, Kursat Computers & Fluids, Vol. 117 https://doi.org/10.1016/j.compfluid.2015.04.026	journal	August 2015
Physical insight into the accuracy of finely-resolved iLES in turbulent boundary layers Ritos, Konstantinos; Kokkinakis, Ioannis W.; Drikakis, Dimitris Computers & Fluids, Vol. 169 https://doi.org/10.1016/j.compfluid.2017.07.018	journal	June 2018
Performance of high-order implicit large eddy simulations Ritos, Konstantinos; Kokkinakis, Ioannis W.; Drikakis, Dimitris Computers & Fluids, Vol. 173 https://doi.org/10.1016/j.compfluid.2018.01.030	journal	September 2018
Direct numerical simulations of reacting flows with detailed chemistry using many-core/GPU acceleration Hernández Pérez, Francisco E.; Mukhadiyev, Nurzhan; Xu, Xiao Computers & Fluids, Vol. 173 https://doi.org/10.1016/j.compfluid.2018.03.074	journal	September 2018
An optical study of in-cylinder CH2O and OH chemiluminescence in flame-induced reaction front propagation using high speed imaging Ma, Xiao; Wang, Zhi; Jiang, Changzhao Fuel, Vol. 134 https://doi.org/10.1016/j.fuel.2014.06.002	journal	October 2014
Mapped weighted essentially non-oscillatory schemes: Achieving optimal order near critical points Henrick, Andrew K.; Aslam, Tariq D.; Powers, Joseph M. Journal of Computational Physics, Vol. 207, Issue 2 https://doi.org/10.1016/j.jcp.2005.01.023	journal	August 2005
Simulations of pulsating one-dimensional detonations with true fifth order accuracy Henrick, Andrew K.; Aslam, Tariq D.; Powers, Joseph M. Journal of Computational Physics, Vol. 213, Issue 1 https://doi.org/10.1016/j.jcp.2005.08.013	journal	March 2006
A bandwidth-optimized WENO scheme for the effective direct numerical simulation of compressible turbulence Martín, M. P.; Taylor, E. M.; Wu, M. Journal of Computational Physics, Vol. 220, Issue 1 https://doi.org/10.1016/j.jcp.2006.05.009	journal	December 2006
An improved weighted essentially non-oscillatory scheme for hyperbolic conservation laws Borges, Rafael; Carmona, Monique; Costa, Bruno Journal of Computational Physics, Vol. 227, Issue 6 https://doi.org/10.1016/j.jcp.2007.11.038	journal	March 2008
Accelerating moderately stiff chemical kinetics in reactive-flow simulations using GPUs Niemeyer, Kyle E.; Sung, Chih-Jen Journal of Computational Physics, Vol. 256 https://doi.org/10.1016/j.jcp.2013.09.025	journal	January 2014
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.07.003	journal	December 2014
Towards dense linear algebra for hybrid GPU accelerated manycore systems Tomov, Stanimire; Dongarra, Jack; Baboulin, Marc Parallel Computing, Vol. 36, Issue 5-6 https://doi.org/10.1016/j.parco.2009.12.005	journal	June 2010
Progress and recent trends in homogeneous charge compression ignition (HCCI) engines Yao, Mingfa; Zheng, Zhaolei; Liu, Haifeng Progress in Energy and Combustion Science, Vol. 35, Issue 5 https://doi.org/10.1016/j.pecs.2009.05.001	journal	October 2009
Evolution, challenges and path forward for low temperature combustion engines Agarwal, Avinash Kumar; Singh, Akhilendra Pratap; Maurya, Rakesh Kumar Progress in Energy and Combustion Science, Vol. 61 https://doi.org/10.1016/j.pecs.2017.02.001	journal	July 2017
Knocking combustion in spark-ignition engines Wang, Zhi; Liu, Hui; Reitz, Rolf D. Progress in Energy and Combustion Science, Vol. 61 https://doi.org/10.1016/j.pecs.2017.03.004	journal	July 2017
The effects of non-uniform temperature distribution on the ignition of a lean homogeneous hydrogen–air mixture Sankaran, Ramanan; Im, Hong G.; Hawkes, Evatt R. Proceedings of the Combustion Institute, Vol. 30, Issue 1 https://doi.org/10.1016/j.proci.2004.08.176	journal	January 2005
Advanced compression-ignition engines—understanding the in-cylinder processes Dec, John E. Proceedings of the Combustion Institute, Vol. 32, Issue 2 https://doi.org/10.1016/j.proci.2008.08.008	journal	January 2009
Kinetic modeling of gasoline surrogate components and mixtures under engine conditions Mehl, Marco; Pitz, William J.; Westbrook, Charles K. Proceedings of the Combustion Institute, Vol. 33, Issue 1 https://doi.org/10.1016/j.proci.2010.05.027	journal	January 2011
Classification of ignition regimes in HCCI combustion using computational singular perturbation Gupta, Saurabh; Im, Hong G.; Valorani, Mauro Proceedings of the Combustion Institute, Vol. 33, Issue 2 https://doi.org/10.1016/j.proci.2010.07.014	journal	January 2011
Analysis of n-heptane auto-ignition characteristics using computational singular perturbation Gupta, Saurabh; Im, Hong G.; Valorani, Mauro Proceedings of the Combustion Institute, Vol. 34, Issue 1 https://doi.org/10.1016/j.proci.2012.07.077	journal	January 2013
Numerical and experimental investigation of turbulent DME jet flames Bhagatwala, Ankit; Luo, Zhaoyu; Shen, Han Proceedings of the Combustion Institute, Vol. 35, Issue 2 https://doi.org/10.1016/j.proci.2014.05.147	journal	January 2015
Ignition of a lean PRF/air mixture under RCCI/SCCI conditions: Chemical aspects Luong, Minh Bau; Yu, Gwang Hyeon; Chung, Suk Ho Proceedings of the Combustion Institute, Vol. 36, Issue 3 https://doi.org/10.1016/j.proci.2016.06.076	journal	January 2017
Computational characterization of ignition regimes in a syngas/air mixture with temperature fluctuations Pal, Pinaki; Valorani, Mauro; Arias, Paul G. Proceedings of the Combustion Institute, Vol. 36, Issue 3 https://doi.org/10.1016/j.proci.2016.07.059	journal	January 2017
Ignition of a lean PRF/air mixture under RCCI/SCCI conditions: A comparative DNS study Luong, Minh Bau; Yu, Gwang Hyeon; Chung, Suk Ho Proceedings of the Combustion Institute, Vol. 36, Issue 3 https://doi.org/10.1016/j.proci.2016.08.038	journal	January 2017
Detonation onset in a thermally stratified constant volume reactor Sow, Aliou; Lee, Bok Jik; Hernández Pérez, Francisco E. Proceedings of the Combustion Institute, Vol. 37, Issue 3 https://doi.org/10.1016/j.proci.2018.08.043	journal	January 2019
Numerical simulation of compressible homogeneous flows in the turbulent regime Passot, T.; Pouquet, A. Journal of Fluid Mechanics, Vol. 181, Issue -1 https://doi.org/10.1017/S0022112087002167	journal	September 1987
Characteristic boundary conditions for simulations of compressible reacting flows with multi-dimensional, viscous and reaction effects Yoo, C. S.; Im, H. G. Combustion Theory and Modelling, Vol. 11, Issue 2 https://doi.org/10.1080/13647830600898995	journal	April 2007
Assessment of Very High Order of Accuracy in Implicit LES models Mosedale, Andrew; Drikakis, Dimitris Journal of Fluids Engineering, Vol. 129, Issue 12 https://doi.org/10.1115/1.2801374	journal	July 2007
A Multicomponent Blend as a Diesel Fuel Surrogate for Compression Ignition Engine Applications Pei, Yuanjiang; Mehl, Marco; Liu, Wei Journal of Engineering for Gas Turbines and Power, Vol. 137, Issue 11 https://doi.org/10.1115/1.4030416	journal	May 2015
On the Construction and Comparison of Difference Schemes Strang, Gilbert SIAM Journal on Numerical Analysis, Vol. 5, Issue 3 https://doi.org/10.1137/0705041	journal	September 1968
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E. ACM Transactions on Mathematical Software, Vol. 31, Issue 3 https://doi.org/10.1145/1089014.1089020	journal	September 2005
Numerical Methods for High-Speed Flows Pirozzoli, Sergio Annual Review of Fluid Mechanics, Vol. 43, Issue 1 https://doi.org/10.1146/annurev-fluid-122109-160718	journal	January 2011
Direct Numerical Simulation of Non-Premixed Turbulent Flames Vervisch, Luc; Poinsot, Thierry Annual Review of Fluid Mechanics, Vol. 30, Issue 1 https://doi.org/10.1146/annurev.fluid.30.1.655	journal	January 1998
Experimental metrics for identifying origins of combustion variability during spark-assisted compression ignition Reuss, D. L.; Kuo, T-W; Silvas, G. International Journal of Engine Research, Vol. 9, Issue 5 https://doi.org/10.1243/14680874JER01108	journal	October 2008

Similar Records

Direct numerical simulations of reacting flows with detailed chemistry using many-core/GPU acceleration

Journal Article · Sat Sep 01 00:00:00 EDT 2018 · Computers and Fluids · OSTI ID:1565647

Direct numerical simulations of reacting flows with detailed chemistry using many-core/GPU acceleration

Journal Article · Wed Mar 28 20:00:00 EDT 2018 · Computers and Fluids · OSTI ID:1784203

GPU accelerated flow solver for direct numerical simulation of turbulent flows

Journal Article · Thu Feb 14 23:00:00 EST 2013 · Journal of Computational Physics · OSTI ID:22233555

Related Subjects

97 MATHEMATICS AND COMPUTING
Direct numerical simulation (DNS)
GPU computing
WENO
compressible turbulence
high performance computing (HPC)
performance analysis

Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Citation Formats

References (60)

Similar Records

Related Subjects