Moment representation in the lattice Boltzmann method on massively parallel hardware

Vardhan, Madhurima; Gounley, John; Hegele, Luiz; Draeger, Erik; Randles, Amanda

doi:10.1145/3295500.3356204

Moment representation in the lattice Boltzmann method on massively parallel hardware

Conference · Fri Nov 01 04:00:00 EDT 2019

DOI:https://doi.org/10.1145/3295500.3356204· OSTI ID:1607181

Vardhan, Madhurima ^[1]; Gounley, John ^[2]; Hegele, Luiz ^[3]; Draeger, Erik ^[4]; Randles, Amanda ^[5]

Duke University
ORNL
Universidade do Estado de Santa Catarina
Lawrence Livermore National Laboratory (LLNL)
Duke university Duhram, NC

The widely-used lattice Boltzmann method (LBM) for computational fluid dynamics is highly scalable, but also significantly memory bandwidth-bound on current architectures. This paper presents a new regularized LBM implementation that reduces the memory footprint by only storing macroscopic, moment-based data. We show that the amount of data that must be stored in memory during a simulation is reduced by up to 47%. We also present a technique for cache-aware data re-utilization and show that optimizing cache utilization to limit data motion results in a similar improvement in time to solution. These new algorithms are implemented in the hemodynamics solver HARVEY and demonstrated using both idealized and realistic biological geometries. We develop a performance model for the moment representation algorithm and evaluate the performance on Summit.

View Conference

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1607181

Country of Publication:: United States

Language:: English

References (34)

Optimization and Profiling of the Cache Performance of Parallel Lattice Boltzmann Codes Pohl, Thomas; Kowarschik, Markus; Wilke, Jens Parallel Processing Letters, Vol. 13, Issue 04 https://doi.org/10.1142/S0129626403001501	journal	December 2003
Extracting ultra-scale Lattice Boltzmann performance via hierarchical and distributed auto-tuning Williams, Samuel; Oliker, Leonid; Carter, Jonathan Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063458	conference	January 2011
Multiple–relaxation–time lattice Boltzmann models in three dimensions d'Humières, Dominique Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, Vol. 360, Issue 1792 https://doi.org/10.1098/rsta.2001.0955	journal	March 2002
Multiscale Simulation of Cardiovascular flows on the IBM Bluegene/P: Full Heart-Circulation System at Red-Blood Cell Resolution Peters, Amanda; Melchionna, Simone; Kaxiras, Efthimios 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.33	conference	November 2010
Lattice Boltzmann benchmark kernels as a testbed for performance analysis Wittmann, M.; Haag, V.; Zeiser, T. Computers & Fluids, Vol. 172 https://doi.org/10.1016/j.compfluid.2018.03.030	journal	August 2018
Esoteric Twist: An Efficient in-Place Streaming Algorithmus for the Lattice Boltzmann Method on Massively Parallel Hardware Geier, Martin; Schönherr, Martin Computation, Vol. 5, Issue 4 https://doi.org/10.3390/computation5020019	journal	March 2017
Lattice Boltzmann simulation optimization on leading multicore platforms Williams, Samuel; Carter, Jonathan; Oliker, Leonid Distributed Processing Symposium (IPDPS), 2008 IEEE International Symposium on Parallel and Distributed Processing https://doi.org/10.1109/IPDPS.2008.4536295	conference	April 2008
An efficient swap algorithm for the lattice Boltzmann method Mattila, Keijo; Hyväluoma, Jari; Rossi, Tuomo Computer Physics Communications, Vol. 176, Issue 3 https://doi.org/10.1016/j.cpc.2006.09.005	journal	February 2007
Lattice Boltzmann method with regularized pre-collision distribution functions Latt, Jonas; Chopard, Bastien Mathematics and Computers in Simulation, Vol. 72, Issue 2-6 https://doi.org/10.1016/j.matcom.2006.05.017	journal	September 2006
A Model for Collision Processes in Gases. I. Small Amplitude Processes in Charged and Neutral One-Component Systems Bhatnagar, P. L.; Gross, E. P.; Krook, M. Physical Review, Vol. 94, Issue 3 https://doi.org/10.1103/PhysRev.94.511	journal	May 1954
On the single processor performance of simple lattice Boltzmann kernels Wellein, G.; Zeiser, T.; Hager, G. Computers & Fluids, Vol. 35, Issue 8-9 https://doi.org/10.1016/j.compfluid.2005.02.008	journal	September 2006
High-Reynolds-number turbulent cavity flow using the lattice Boltzmann method Hegele, L. A.; Scagliarini, A.; Sbragaglia, M. Physical Review E, Vol. 98, Issue 4 https://doi.org/10.1103/PhysRevE.98.043302	journal	October 2018
Multiscale modeling of fluid transport in heterogeneous materials using discrete Boltzmann methods Martys, N. S.; Hagedorn, J. G. Materials and Structures, Vol. 35, Issue 10 https://doi.org/10.1007/BF02480358	journal	December 2002
A framework for hybrid parallel flow simulations with a trillion cells in complex geometries Godenschwager, Christian; Schornbaum, Florian; Bauer, Martin Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13 https://doi.org/10.1145/2503210.2503273	conference	January 2013
Roofline: An Insightful Visual Performance Model for Floating-Point Programs and Multicore Architectures Williams, Samuel; Waterman, Andrew; Patterson, David https://doi.org/10.2172/1407078	report	September 2009
Efficiently using memory in lattice Boltzmann simulations Argentini, R.; Bakker, A. F.; Lowe, C. P. Future Generation Computer Systems, Vol. 20, Issue 6 https://doi.org/10.1016/j.future.2003.12.010	journal	August 2004
Introducing a parallel cache oblivious blocking approach for the lattice Boltzmann method Zeiser, T.; Wellein, G.; Nitsure, A. Progress in Computational Fluid Dynamics, An International Journal, Vol. 8, Issue 1/2/3/4 https://doi.org/10.1504/PCFD.2008.018088	journal	January 2008
GPU Data Access on Complex Geometries for D3Q19 Lattice Boltzmann Method Herschlag, Gregory; Lee, Seyong; Vetter, Jeffrey S. 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2018.00092	conference	May 2018
Designing a Parallel Memory-Aware Lattice Boltzmann Algorithm on Manycore Systems Fu, Yuankun; Li, Feng; Song, Fengguang 2018 30th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) https://doi.org/10.1109/CAHPC.2018.8645909	conference	September 2018
Straight velocity boundaries in the lattice Boltzmann method Latt, Jonas; Chopard, Bastien; Malaspinas, Orestis Physical Review E, Vol. 77, Issue 5 https://doi.org/10.1103/PhysRevE.77.056703	journal	May 2008
Noninvasive Derivation of Fractional Flow Reserve From Coronary Computed Tomographic Angiography Benton, Stewart M.; Tesche, Christian; De Cecco, Carlo N. Journal of Thoracic Imaging, Vol. 33, Issue 2 https://doi.org/10.1097/RTI.0000000000000289	journal	March 2018
Lattice Boltzmann Method for Fluid Flows Chen, Shiyi; Doolen, Gary D. Annual Review of Fluid Mechanics, Vol. 30, Issue 1 https://doi.org/10.1146/annurev.fluid.30.1.329	journal	January 1998
Accelerating the Parallelization of Lattice Boltzmann Method by Exploiting the Temporal Locality Liu, Song; Zou, Nianjun; Cui, Yuanzhen 2017 IEEE International Symposium on Parallel and Distributed Processing with Applications and 2017 IEEE International Conference on Ubiquitous Computing and Communications (ISPA/IUCC) https://doi.org/10.1109/ISPA/IUCC.2017.00178	conference	December 2017
Comparison of different propagation steps for lattice Boltzmann methods Wittmann, Markus; Zeiser, Thomas; Hager, Georg Computers & Mathematics with Applications, Vol. 65, Issue 6 https://doi.org/10.1016/j.camwa.2012.05.002	journal	March 2013
Towards Exascale Lattice Boltzmann computing Succi, S.; Amati, G.; Bernaschi, M. Computers & Fluids, Vol. 181 https://doi.org/10.1016/j.compfluid.2019.01.005	journal	March 2019
Efficient Temporal Blocking for Stencil Computations by Multicore-Aware Wavefront Parallelization Wellein, Gerhard; Hager, Georg; Zeiser, Thomas 2009 33rd Annual IEEE International Computer Software and Applications Conference https://doi.org/10.1109/COMPSAC.2009.82	conference	July 2009
On pressure and velocity boundary conditions for the lattice Boltzmann BGK model Zou, Qisu; He, Xiaoyi Physics of Fluids, Vol. 9, Issue 6 https://doi.org/10.1063/1.869307	journal	June 1997
Accelerating Lattice Boltzmann Fluid Flow Simulations Using Graphics Processors Bailey, P.; Myre, J.; Walsh, S. D. C. 2009 International Conference on Parallel Processing (ICPP 2009) https://doi.org/10.1109/ICPP.2009.38	conference	September 2009
Massively parallel models of the human circulatory system Randles, Amanda; Draeger, Erik W.; Oppelstrup, Tomas SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/2807591.2807676	conference	November 2015
A parallel workload balanced and memory efficient lattice-Boltzmann algorithm with single unit BGK relaxation time for laminar Newtonian flows Vidal, David; Roy, Robert; Bertrand, François Computers & Fluids, Vol. 39, Issue 8 https://doi.org/10.1016/j.compfluid.2010.04.011	journal	September 2010
Performance Analysis of the Lattice Boltzmann Model Beyond Navier-Stokes Randles, Amanda Peters; Kale, Vivek; Hammond, Jeff 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on Parallel and Distributed Processing https://doi.org/10.1109/IPDPS.2013.109	conference	May 2013
Petaflop biofluidics simulations on a two million-core system Bernaschi, Massimo; Bisson, Mauro; Endo, Toshio Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063389	conference	January 2011
A scalable interface-resolved simulation of particle-laden flow using the lattice Boltzmann method Geneva, Nicholas; Peng, Cheng; Li, Xiaoming Parallel Computing, Vol. 67 https://doi.org/10.1016/j.parco.2017.07.005	journal	September 2017
Performance Evaluation of Parallel Large-Scale Lattice Boltzmann Applications on Three Supercomputing Architectures Pohl, T.; Deserno, F.; Thurey, N. Proceedings of the ACM/IEEE SC2004 Conference https://doi.org/10.1109/SC.2004.37	conference	January 2004

Similar Records

Propagation Pattern for Moment Representation of the Lattice Boltzmann Method

Journal Article · Tue Jul 20 20:00:00 EDT 2021 · IEEE Transactions on Parallel and Distributed Systems · OSTI ID:1814345

Moment Representation of Regularized Lattice Boltzmann Methods on NVIDIA and AMD GPUs

Conference · Wed Nov 01 00:00:00 EDT 2023 · OSTI ID:2224172

Moment representation in the lattice Boltzmann method on massively parallel hardware

Citation Formats

References (34)

Similar Records

Related Subjects