Simulations of plasmas and fluids using anti-symmetric models

Halpern, Federico D.; Sfiligoi, Igor; Kostuk, Mark; Stefan, Ryan; Waltz, Ronald E.

doi:10.1016/j.jcp.2021.110631

Title: Simulations of plasmas and fluids using anti-symmetric models

Journal Article · 10 August 2021 · Journal of Computational Physics

DOI: https://doi.org/10.1016/j.jcp.2021.110631 · OSTI ID:1977267

Halpern, Federico D. ^[1];

^[2];

^[2]; Stefan, Ryan ^[2]; Waltz, Ronald E. ^[2]

General Atomics, San Diego, CA (United States); OSTI
General Atomics, San Diego, CA (United States)

ALMA (Anti-symmetric, Large-Moment, Accelerated) is a fast, flexible, and scalable toolkit designed to solve hyperbolic conservation law systems in hybrid supercomputers. Here this manuscript describes the theoretical background and implementation of ALMA, which uses the anti-symmetric formulation of fluids to obtain simple, robust, and easily paralellizable code. Practical GPU acceleration is realized on entire applications with an overall gain factor of 2 to 4. ALMA also provides a parallel, GPU accelerated sparse solver based on geometric multigrid, capable of diagonalizing linear systems with 239 unknowns. Here we demonstrate ALMA's scaling and performance in petascale supercomputers and use standard fluid models to verify the overall approach with canonical benchmark problems.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: General Atomics, San Diego, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Fusion Energy Sciences (FES)

Grant/Contract Number:: AC02-05CH11231; AC02-06CH11357; AC05-00OR22725; FG02-95ER54309

OSTI ID:: 1977267

Journal Information:: Journal of Computational Physics, Journal Name: Journal of Computational Physics Journal Issue: C Vol. 445; ISSN 0021-9991

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (60)

Über die Ausbreitung von Wellen in einem Plasma Lüst, Reimar Fortschritte der Physik, Vol. 7, Issue 9 https://doi.org/10.1002/prop.19590070902	journal	January 1959
Summation by Parts for Finite Difference Approximations for d/dx Strand, Bo Journal of Computational Physics, Vol. 110, Issue 1 https://doi.org/10.1006/jcph.1994.1005	journal	January 1994
Weighted Essentially Non-oscillatory Schemes Liu, Xu-Dong; Osher, Stanley; Chan, Tony Journal of Computational Physics, Vol. 115, Issue 1 https://doi.org/10.1006/jcph.1994.1187	journal	November 1994
Efficient Implementation of Weighted ENO Schemes Jiang, Guang-Shan; Shu, Chi-Wang Journal of Computational Physics, Vol. 126, Issue 1 https://doi.org/10.1006/jcph.1996.0130	journal	June 1996
Fully Conservative Higher Order Finite Difference Schemes for Incompressible Flow Morinishi, Y.; Lund, T. S.; Vasilyev, O. V. Journal of Computational Physics, Vol. 143, Issue 1 https://doi.org/10.1006/jcph.1998.5962	journal	June 1998
Fast and High Accuracy Multigrid Solution of the Three Dimensional Poisson Equation Zhang, Jun Journal of Computational Physics, Vol. 143, Issue 2 https://doi.org/10.1006/jcph.1998.5982	journal	July 1998
Numerical Convergence Study of Nearly Incompressible, Inviscid Taylor–Green Vortex Flow Shu, Chi-Wang; Don, Wai-Sun; Gottlieb, David Journal of Scientific Computing, Vol. 24, Issue 1 https://doi.org/10.1007/s10915-004-5407-y	journal	July 2005
Computational design for long-term numerical integration of the equations of fluid motion: Two-dimensional incompressible flow. Part I Arakawa, Akio Journal of Computational Physics, Vol. 1, Issue 1 https://doi.org/10.1016/0021-9991(66)90015-5	journal	August 1966
Towards the ultimate conservative difference scheme. II. Monotonicity and conservation combined in a second-order scheme van Leer, Bram Journal of Computational Physics, Vol. 14, Issue 4 https://doi.org/10.1016/0021-9991(74)90019-9	journal	March 1974
Towards the ultimate conservative difference scheme. V. A second-order sequel to Godunov's method van Leer, Bram Journal of Computational Physics, Vol. 32, Issue 1 https://doi.org/10.1016/0021-9991(79)90145-1	journal	July 1979
Approximate Riemann solvers, parameter vectors, and difference schemes Roe, P. L. Journal of Computational Physics, Vol. 43, Issue 2 https://doi.org/10.1016/0021-9991(81)90128-5	journal	October 1981
The Piecewise Parabolic Method (PPM) for gas-dynamical simulations Colella, Phillip; Woodward, Paul R. Journal of Computational Physics, Vol. 54, Issue 1 https://doi.org/10.1016/0021-9991(84)90143-8	journal	April 1984
Generalizations of Arakawa's Jacobian Salmon, Rick; Talley, Lynne D. Journal of Computational Physics, Vol. 83, Issue 2 https://doi.org/10.1016/0021-9991(89)90118-6	journal	August 1989
An adaptive step size controller for iterative implicit methods Einkemmer, Lukas Applied Numerical Mathematics, Vol. 132 https://doi.org/10.1016/j.apnum.2018.06.002	journal	October 2018
Performance prediction of finite-difference solvers for different computer architectures Louboutin, Mathias; Lange, Michael; Herrmann, Felix J. Computers & Geosciences, Vol. 105 https://doi.org/10.1016/j.cageo.2017.04.014	journal	August 2017
Review of summation-by-parts operators with simultaneous approximation terms for the numerical solution of partial differential equations Del Rey Fernández, David C.; Hicken, Jason E.; Zingg, David W. Computers & Fluids, Vol. 95 https://doi.org/10.1016/j.compfluid.2014.02.016	journal	May 2014
Conservative time integrators of arbitrary order for skew-symmetric finite-difference discretizations of compressible flow Brouwer, Jens; Reiss, Julius; Sesterhenn, Jörn Computers & Fluids, Vol. 100 https://doi.org/10.1016/j.compfluid.2014.04.019	journal	September 2014
A conservative, skew-symmetric finite difference scheme for the compressible Navier–Stokes equations Reiss, Julius; Sesterhenn, Jörn Computers & Fluids, Vol. 101 https://doi.org/10.1016/j.compfluid.2014.06.004	journal	September 2014
Productivity, performance, and portability for computational fluid dynamics applications Reguly, István Z.; Mudalige, Gihan R. Computers & Fluids, Vol. 199 https://doi.org/10.1016/j.compfluid.2020.104425	journal	March 2020
BOUT++: A framework for parallel plasma fluid simulations Dudson, B. D.; Umansky, M. V.; Xu, X. Q. Computer Physics Communications, Vol. 180, Issue 9 https://doi.org/10.1016/j.cpc.2009.03.008	journal	September 2009
GDB: A global 3D two-fluid model of plasma turbulence and transport in the tokamak edge Zhu, Ben; Francisquez, Manaure; Rogers, Barrett N. Computer Physics Communications, Vol. 232 https://doi.org/10.1016/j.cpc.2018.06.002	journal	November 2018
Reproducibility, accuracy and performance of the Feltor code and library on parallel computer architectures Wiesenberger, Matthias; Einkemmer, Lukas; Held, Markus Computer Physics Communications, Vol. 238 https://doi.org/10.1016/j.cpc.2018.12.006	journal	May 2019
Implications of a metric for performance portability Pennycook, S. J.; Sewall, J. D.; Lee, V. W. Future Generation Computer Systems, Vol. 92 https://doi.org/10.1016/j.future.2017.08.007	journal	March 2019
Summation by parts operators for finite difference approximations of second derivatives Mattsson, Ken; Nordström, Jan Journal of Computational Physics, Vol. 199, Issue 2 https://doi.org/10.1016/j.jcp.2004.03.001	journal	September 2004
A fully discrete, kinetic energy consistent finite-volume scheme for compressible flows Subbareddy, Pramod K.; Candler, Graham V. Journal of Computational Physics, Vol. 228, Issue 5 https://doi.org/10.1016/j.jcp.2008.10.026	journal	March 2009
Preserving energy resp. dissipation in numerical PDEs using the “Average Vector Field” method Celledoni, E.; Grimm, V.; McLachlan, R. I. Journal of Computational Physics, Vol. 231, Issue 20 https://doi.org/10.1016/j.jcp.2012.06.022	journal	August 2012
Review of summation-by-parts schemes for initial–boundary-value problems Svärd, Magnus; Nordström, Jan Journal of Computational Physics, Vol. 268 https://doi.org/10.1016/j.jcp.2014.02.031	journal	July 2014
Leveraging Anderson Acceleration for improved convergence of iterative solutions to transport systems Willert, Jeffrey; Taitano, William T.; Knoll, Dana Journal of Computational Physics, Vol. 273 https://doi.org/10.1016/j.jcp.2014.05.015	journal	September 2014
The GBS code for tokamak scrape-off layer simulations Halpern, F. D.; Ricci, P.; Jolliet, S. Journal of Computational Physics, Vol. 315 https://doi.org/10.1016/j.jcp.2016.03.040	journal	June 2016
A fourth-order accurate finite volume method for ideal MHD via upwind constrained transport Felker, Kyle Gerard; Stone, James M. Journal of Computational Physics, Vol. 375 https://doi.org/10.1016/j.jcp.2018.08.025	journal	December 2018
Small-scale structure of two-dimensional magnetohydrodynamic turbulence Orszag, Steven A.; Tang, Cha-Mei Journal of Fluid Mechanics, Vol. 90, Issue 1 https://doi.org/10.1017/S002211207900210X	journal	January 1979
Small-scale structure of the Taylor–Green vortex Brachet, Marc E.; Meiron, Daniel I.; Orszag, Steven A. Journal of Fluid Mechanics, Vol. 130, Issue -1 https://doi.org/10.1017/S0022112083001159	journal	May 1983
Drift-ordered fluid equations for field-aligned modes in low-β collisional plasma with equilibrium pressure pedestals Simakov, Andrei N.; Catto, Peter J. Physics of Plasmas, Vol. 10, Issue 12 https://doi.org/10.1063/1.1623492	journal	December 2003
Erratum: “Drift-ordered fluid equations for field-aligned modes in low-β collisional plasma with equilibrium pressure pedestals” [Phys. Plasmas 10 , 4744 (2003)] Simakov, Andrei N.; Catto, Peter J. Physics of Plasmas, Vol. 11, Issue 5 https://doi.org/10.1063/1.1703527	journal	May 2004
On energy conservation in extended magnetohydrodynamics Kimura, Keiji; Morrison, P. J. Physics of Plasmas, Vol. 21, Issue 8 https://doi.org/10.1063/1.4890955	journal	August 2014
Exact collisional moments for plasma fluid theories Pfefferlé, D.; Hirvijoki, E.; Lingam, M. Physics of Plasmas, Vol. 24, Issue 4 https://doi.org/10.1063/1.4979992	journal	April 2017
Structure and structure-preserving algorithms for plasma physics Morrison, P. J. Physics of Plasmas, Vol. 24, Issue 5 https://doi.org/10.1063/1.4982054	journal	April 2017
Anti-symmetric plasma moment equations with conservative discrete counterparts Halpern, Federico D.; Waltz, Ronald E. Physics of Plasmas, Vol. 25, Issue 6 https://doi.org/10.1063/1.5038110	journal	June 2018
Continuum electromagnetic gyrokinetic simulations of turbulence in the tokamak scrape-off layer and laboratory devices Hakim, Ammar H.; Mandell, Noah R.; Bernard, T. N. Physics of Plasmas, Vol. 27, Issue 4 https://doi.org/10.1063/1.5141157	journal	April 2020
Nonlinear reduced Braginskii equations with ion thermal dynamics in toroidal plasma Zeiler, A.; Drake, J. F.; Rogers, B. Physics of Plasmas, Vol. 4, Issue 6 https://doi.org/10.1063/1.872368	journal	June 1997
Anti-symmetric representation of the extended magnetohydrodynamic equations Halpern, Federico D. Physics of Plasmas, Vol. 27, Issue 4 https://doi.org/10.1063/5.0002345	journal	April 2020
Fluid and gyrokinetic turbulence in open field-line, helical plasmas Francisquez, M.; Bernard, T. N.; Zhu, B. Physics of Plasmas, Vol. 27, Issue 8 https://doi.org/10.1063/5.0005333	journal	August 2020
Hamiltonian Systems and Transformation in Hilbert Space Koopman, B. O. Proceedings of the National Academy of Sciences, Vol. 17, Issue 5 https://doi.org/10.1073/pnas.17.5.315	journal	May 1931
FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes Fryxell, B.; Olson, K.; Ricker, P. The Astrophysical Journal Supplement Series, Vol. 131, Issue 1 https://doi.org/10.1086/317361	journal	November 2000
Transport equations and gradient instabilities in a high pressure collisional plasma Mikhailovskii, A. B.; Tsypin, V. S. Plasma Physics, Vol. 13, Issue 9 https://doi.org/10.1088/0032-1028/13/9/009	journal	September 1971
Velocity shear, turbulent saturation, and steep plasma gradients in the scrape-off layer of inner-wall limited tokamaks Halpern, F. D.; Ricci, P. Nuclear Fusion, Vol. 57, Issue 3 https://doi.org/10.1088/1741-4326/aa4eb6	journal	December 2016
Implicit Runge-Kutta processes Butcher, J. C. Mathematics of Computation, Vol. 18, Issue 85 https://doi.org/10.1090/S0025-5718-1964-0159424-9	journal	January 1964
Stability of Runge-Kutta Methods for Trajectory Problems Cooper, G. J. IMA Journal of Numerical Analysis, Vol. 7, Issue 1 https://doi.org/10.1093/imanum/7.1.1	journal	January 1987
Geometric integration using discrete gradients McLachlan, Robert I.; Quispel, G. R. W.; Robidoux, Nicolas Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, Vol. 357, Issue 1754 https://doi.org/10.1098/rsta.1999.0363	journal	April 1999
Noncanonical Hamiltonian Density Formulation of Hydrodynamics and Ideal Magnetohydrodynamics Morrison, Philip J.; Greene, John M. Physical Review Letters, Vol. 45, Issue 10 https://doi.org/10.1103/PhysRevLett.45.790	journal	September 1980
Foundations of nonlinear gyrokinetic theory Brizard, A. J.; Hahm, T. S. Reviews of Modern Physics, Vol. 79, Issue 2 https://doi.org/10.1103/RevModPhys.79.421	journal	April 2007
Optimum Positive Linear Schemes for Advection in Two and Three Dimensions Roe, P. L.; Sidilkover, D. SIAM Journal on Numerical Analysis, Vol. 29, Issue 6 https://doi.org/10.1137/0729089	journal	December 1992
Total-Variation-Diminishing Time Discretizations Shu, Chi-Wang SIAM Journal on Scientific and Statistical Computing, Vol. 9, Issue 6 https://doi.org/10.1137/0909073	journal	November 1988
Anderson Acceleration for Fixed-Point Iterations Walker, Homer F.; Ni, Peng SIAM Journal on Numerical Analysis, Vol. 49, Issue 4 https://doi.org/10.1137/10078356X	journal	January 2011
A New Class of Optimal High-Order Strong-Stability-Preserving Time Discretization Methods Spiteri, Raymond J.; Ruuth, Steven J. SIAM Journal on Numerical Analysis, Vol. 40, Issue 2 https://doi.org/10.1137/S0036142901389025	journal	January 2002
Accuracy of Spectral and Finite Difference Schemes in 2D Advection Problems Naulin, Volker; Nielsen, Anders H. SIAM Journal on Scientific Computing, Vol. 25, Issue 1 https://doi.org/10.1137/S1064827502405070	journal	January 2003
Roofline: an insightful visual performance model for multicore architectures Williams, Samuel; Waterman, Andrew; Patterson, David Communications of the ACM, Vol. 52, Issue 4 https://doi.org/10.1145/1498765.1498785	journal	April 2009
Iterative Procedures for Nonlinear Integral Equations Anderson, Donald G. Journal of the ACM, Vol. 12, Issue 4 https://doi.org/10.1145/321296.321305	journal	October 1965
Hamiltonian Fluid Mechanics Salmon, R. Annual Review of Fluid Mechanics, Vol. 20, Issue 1 https://doi.org/10.1146/annurev.fl.20.010188.001301	journal	January 1988
Zur Operatorenmethode In Der Klassischen Mechanik v. Neumann, J. The Annals of Mathematics, Vol. 33, Issue 3 https://doi.org/10.2307/1968537	journal	July 1932

Similar Records

A GPU-Accelerated Structurally-Symmetric Sparse Multifrontal Solver

Conference · 2019 · OSTI ID:1605252

Synk, Ryan; Ghysels, Pieter

Preparing an Incompressible-Flow Fluid Dynamics Code for Exascale-Class Wind Energy Simulations

Conference · 2021 · OSTI ID:1832419

Mullowney, Paul; Li, Ruipeng; Thomas, Stephen; +5 more

TeaLeaf: A Mini-Application to Enable Design-Space Explorations for Iterative Sparse Linear Solvers

Conference · 2017 · OSTI ID:1567450

McIntosh-Smith, Simon; Martineau, Matthew; Deakin, Tom; +6 more

Related Subjects

71 CLASSICAL AND QUANTUM MECHANICS
GENERAL PHYSICS
97 MATHEMATICS AND COMPUTING
anti-symmetry
conservation
plasma
turbulence

Title: Simulations of plasmas and fluids using anti-symmetric models

Citation Formats

References (60)

Similar Records

Related Subjects