Noise and error analysis and optimization in particle-based kinetic plasma simulations
Abstract
In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constantmore »
- Authors:
-
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Tibbar Plasma Technologies, Los Alamos, NM (United States)
- Univ. of Nebraska, Lincoln, NE (United States)
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); National Aeronautics and Space Administration (NASA); National Science Foundation (NSF); USDOE Laboratory Directed Research and Development (LDRD) Program
- OSTI Identifier:
- 1783529
- Alternate Identifier(s):
- OSTI ID: 1815097; OSTI ID: 1828027
- Report Number(s):
- LA-UR-20-26648; SAND-2021-5417J
Journal ID: ISSN 0021-9991
- Grant/Contract Number:
- 89233218CNA000001; NA0003525; NNX15AK74A; PHY-1535678; AC52-06NA25396; 209240
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 440; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 70 PLASMA PHYSICS AND FUSION TECHNOLOGY; Particle-in-cell (PIC); noise; error; statistical analysis; bias-variance optimization; Ornstein-Uhlenbeck bridge; partition of unity; particle-in-cell (PIC)
Citation Formats
Evstatiev, E. G., Finn, J. M., Shadwick, B. A., and Hengartner, N. Noise and error analysis and optimization in particle-based kinetic plasma simulations. United States: N. p., 2021.
Web. doi:10.1016/j.jcp.2021.110394.
Evstatiev, E. G., Finn, J. M., Shadwick, B. A., & Hengartner, N. Noise and error analysis and optimization in particle-based kinetic plasma simulations. United States. https://doi.org/10.1016/j.jcp.2021.110394
Evstatiev, E. G., Finn, J. M., Shadwick, B. A., and Hengartner, N. Wed .
"Noise and error analysis and optimization in particle-based kinetic plasma simulations". United States. https://doi.org/10.1016/j.jcp.2021.110394. https://www.osti.gov/servlets/purl/1783529.
@article{osti_1783529,
title = {Noise and error analysis and optimization in particle-based kinetic plasma simulations},
author = {Evstatiev, E. G. and Finn, J. M. and Shadwick, B. A. and Hengartner, N.},
abstractNote = {In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constant density, p(x), still with continuous x, we analyze the total error in the density estimation and discuss it in terms of bias-variance optimization (BVO). For some characteristic length l, determined by the density and its second derivative, and kernel width h, having too few particles within h leads to too much variance; for h that is large relative to l, there is too much smoothing of the density. The optimum between these two limits is found by BVO. For kernels of the same width, it is shown that this optimum (minimum) is weakly sensitive to the kernel shape. Next, we repeat the analysis for x discretized on a grid. In this case the charge deposition rule is determined by a particle shape. An important property to be respected in the discrete system is the exact preservation of total charge on the grid; this property is necessary to ensure that the electric field is equal at both ends, consistent with periodic boundary conditions. We find that if the particle shapes satisfy a partition of unity property, the particle charge deposited on the grid is conserved exactly. Further, if the particle shape is expressed as the convolution of a kernel with another kernel that satisfies the partition of unity, then the particle shape obeys the partition of unity. This property holds for kernels of arbitrary width, including widths that are not integer multiples of the grid spacing. Furthermore, we show results relaxing the approximations used to do BVO optimization analytically, by doing numerical computations of the total error as a function of the kernel width, on a grid in x. The comparison between numerical and analytical results shows good agreement over a range of particle shapes. We discuss the practical implications of our results, including the criteria for design and implementation of computationally efficient particle shapes that take advantage of the developed theory.},
doi = {10.1016/j.jcp.2021.110394},
journal = {Journal of Computational Physics},
number = ,
volume = 440,
place = {United States},
year = {Wed May 05 00:00:00 EDT 2021},
month = {Wed May 05 00:00:00 EDT 2021}
}
Works referenced in this record:
A fully nonlinear characteristic method for gyrokinetic simulation
journal, January 1993
- Parker, S. E.; Lee, W. W.
- Physics of Fluids B: Plasma Physics, Vol. 5, Issue 1
Kinetic theory for fluctuations and noise in computer simulation of plasma
journal, January 1979
- Langdon, A. Bruce
- Physics of Fluids, Vol. 22, Issue 1
δf Algorithm
journal, July 1995
- Denton, Richard E.; Kotschenreuther, M.
- Journal of Computational Physics, Vol. 119, Issue 2
Generalized weighting scheme for δ f particle‐simulation method
journal, April 1994
- Hu, Genze; Krommes, John A.
- Physics of Plasmas, Vol. 1, Issue 4
Non-Parametric Estimation of a Multivariate Probability Density
journal, January 1969
- Epanechnikov, V. A.
- Theory of Probability & Its Applications, Vol. 14, Issue 1
Constraint Ornstein-Uhlenbeck bridges
journal, September 2017
- Mazzolo, Alain
- Journal of Mathematical Physics, Vol. 58, Issue 9
Optimal Approximations of Transport Equations by Particle and Pseudoparticle Methods
journal, January 2000
- Cohen, Albert; Perthame, Benoit
- SIAM Journal on Mathematical Analysis, Vol. 32, Issue 3
GEMPIC: geometric electromagnetic particle-in-cell methods
journal, July 2017
- Kraus, Michael; Kormann, Katharina; Morrison, Philip J.
- Journal of Plasma Physics, Vol. 83, Issue 4
Computer Experiment of Anomalous Diffusion
journal, January 1966
- Hockney, R. W.
- Physics of Fluids, Vol. 9, Issue 9
The energy conserving particle-in-cell method
journal, August 2011
- Markidis, Stefano; Lapenta, Giovanni
- Journal of Computational Physics, Vol. 230, Issue 18
Comments on: The Maxwell-Vlasov equations as a continuous hamiltonian system
journal, November 1981
- Weinstein, Alan; Morrison, Philip J.
- Physics Letters A, Vol. 86, Issue 4
Clouds-in-clouds, clouds-in-cells physics for many-body plasma simulation
journal, April 1969
- Birdsall, Charles K.; Fuss, Dieter
- Journal of Computational Physics, Vol. 3, Issue 4
An energy- and charge-conserving, implicit, electrostatic particle-in-cell algorithm
journal, August 2011
- Chen, G.; Chacón, L.; Barnes, D. C.
- Journal of Computational Physics, Vol. 230, Issue 18
The Maxwell-Vlasov equations as a continuous hamiltonian system
journal, December 1980
- Morrison, Philip J.
- Physics Letters A, Vol. 80, Issue 5-6
Variational formulation of particle algorithms for kinetic plasma simulations
journal, July 2013
- Evstatiev, E. G.; Shadwick, B. A.
- Journal of Computational Physics, Vol. 245
Geometric integration of the Vlasov-Maxwell system with a variational particle-in-cell scheme
journal, August 2012
- Squire, J.; Qin, H.; Tang, W. M.
- Physics of Plasmas, Vol. 19, Issue 8
Reducing noise for PIC simulations using kernel density estimation algorithm
journal, October 2018
- Wu, Wentao; Qin, Hong
- Physics of Plasmas, Vol. 25, Issue 10
Variational Formulation of Macroparticle Models for Electromagnetic Plasma Simulations
journal, June 2014
- Stamm, Alexander B.; Shadwick, Bradley A.; Evstatiev, Evstati G.
- IEEE Transactions on Plasma Science, Vol. 42, Issue 6
Energy-conserving numerical approximations for Vlasov plasmas
journal, August 1970
- Lewis, H. Ralph
- Journal of Computational Physics, Vol. 6, Issue 1
FLIP: A method for adaptively zoned, particle-in-cell calculations of fluid flows in two dimensions
journal, August 1986
- Brackbill, J. U.; Ruppel, H. M.
- Journal of Computational Physics, Vol. 65, Issue 2
Variational formulation of macro-particle plasma simulation algorithms
journal, May 2014
- Shadwick, B. A.; Stamm, A. B.; Evstatiev, E. G.
- Physics of Plasmas, Vol. 21, Issue 5
Theory of Plasma Simulation Using Finite-Size Particles
journal, January 1970
- Langdon, A. Bruce
- Physics of Fluids, Vol. 13, Issue 8
Collisional delta- f scheme with evolving background for transport time scale simulations
journal, December 1999
- Brunner, S.; Valeo, E.; Krommes, J. A.
- Physics of Plasmas, Vol. 6, Issue 12
Particle simulation of plasmas
journal, April 1983
- Dawson, John M.
- Reviews of Modern Physics, Vol. 55, Issue 2
FLIP: A method for adaptively zoned, particle-in-cell calculations of fluid flows in two dimensions
journal, August 1986
- Brackbill, J. U.; Ruppel, H. M.
- Journal of Computational Physics, Vol. 65, Issue 2
The energy conserving particle-in-cell method
journal, August 2011
- Markidis, Stefano; Lapenta, Giovanni
- Journal of Computational Physics, Vol. 230, Issue 18