DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Noise and error analysis and optimization in particle-based kinetic plasma simulations

Abstract

In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constantmore » density, p(x), still with continuous x, we analyze the total error in the density estimation and discuss it in terms of bias-variance optimization (BVO). For some characteristic length l, determined by the density and its second derivative, and kernel width h, having too few particles within h leads to too much variance; for h that is large relative to l, there is too much smoothing of the density. The optimum between these two limits is found by BVO. For kernels of the same width, it is shown that this optimum (minimum) is weakly sensitive to the kernel shape. Next, we repeat the analysis for x discretized on a grid. In this case the charge deposition rule is determined by a particle shape. An important property to be respected in the discrete system is the exact preservation of total charge on the grid; this property is necessary to ensure that the electric field is equal at both ends, consistent with periodic boundary conditions. We find that if the particle shapes satisfy a partition of unity property, the particle charge deposited on the grid is conserved exactly. Further, if the particle shape is expressed as the convolution of a kernel with another kernel that satisfies the partition of unity, then the particle shape obeys the partition of unity. This property holds for kernels of arbitrary width, including widths that are not integer multiples of the grid spacing. Furthermore, we show results relaxing the approximations used to do BVO optimization analytically, by doing numerical computations of the total error as a function of the kernel width, on a grid in x. The comparison between numerical and analytical results shows good agreement over a range of particle shapes. We discuss the practical implications of our results, including the criteria for design and implementation of computationally efficient particle shapes that take advantage of the developed theory.« less

Authors:
 [1];  [2];  [3]; ORCiD logo [4]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Tibbar Plasma Technologies, Los Alamos, NM (United States)
  3. Univ. of Nebraska, Lincoln, NE (United States)
  4. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); National Aeronautics and Space Administration (NASA); National Science Foundation (NSF); USDOE Laboratory Directed Research and Development (LDRD) Program
OSTI Identifier:
1783529
Alternate Identifier(s):
OSTI ID: 1815097; OSTI ID: 1828027
Report Number(s):
LA-UR-20-26648; SAND-2021-5417J
Journal ID: ISSN 0021-9991
Grant/Contract Number:  
89233218CNA000001; NA0003525; NNX15AK74A; PHY-1535678; AC52-06NA25396; 209240
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 440; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
70 PLASMA PHYSICS AND FUSION TECHNOLOGY; Particle-in-cell (PIC); noise; error; statistical analysis; bias-variance optimization; Ornstein-Uhlenbeck bridge; partition of unity; particle-in-cell (PIC)

Citation Formats

Evstatiev, E. G., Finn, J. M., Shadwick, B. A., and Hengartner, N. Noise and error analysis and optimization in particle-based kinetic plasma simulations. United States: N. p., 2021. Web. doi:10.1016/j.jcp.2021.110394.
Evstatiev, E. G., Finn, J. M., Shadwick, B. A., & Hengartner, N. Noise and error analysis and optimization in particle-based kinetic plasma simulations. United States. https://doi.org/10.1016/j.jcp.2021.110394
Evstatiev, E. G., Finn, J. M., Shadwick, B. A., and Hengartner, N. Wed . "Noise and error analysis and optimization in particle-based kinetic plasma simulations". United States. https://doi.org/10.1016/j.jcp.2021.110394. https://www.osti.gov/servlets/purl/1783529.
@article{osti_1783529,
title = {Noise and error analysis and optimization in particle-based kinetic plasma simulations},
author = {Evstatiev, E. G. and Finn, J. M. and Shadwick, B. A. and Hengartner, N.},
abstractNote = {In this paper we analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We begin by describing kernel density estimation for continuous values of the spatial variable x, expressing the kernel in a form in which its shape and width are represented separately. The covariance matrix of the noise in the density is computed, first for uniform true density. The bandwidth of the covariance matrix C(x,y) is related to the width of the kernel. A feature that stands out is the presence of constant negative terms in the elements of the covariance matrix both on and off-diagonal. These negative correlations are related to the fact that the total number of particles is fixed at each time step; they also lead to the property ∫C(x,y)dy = 0. We investigate the effect of these negative correlations on the electric field computed by Gauss's law, finding that the noise in the electric field is related to a process called the Ornstein-Uhlenbeck bridge, leading to a covariance matrix of the electric field with variance significantly reduced relative to that of a Brownian process. For non-constant density, p(x), still with continuous x, we analyze the total error in the density estimation and discuss it in terms of bias-variance optimization (BVO). For some characteristic length l, determined by the density and its second derivative, and kernel width h, having too few particles within h leads to too much variance; for h that is large relative to l, there is too much smoothing of the density. The optimum between these two limits is found by BVO. For kernels of the same width, it is shown that this optimum (minimum) is weakly sensitive to the kernel shape. Next, we repeat the analysis for x discretized on a grid. In this case the charge deposition rule is determined by a particle shape. An important property to be respected in the discrete system is the exact preservation of total charge on the grid; this property is necessary to ensure that the electric field is equal at both ends, consistent with periodic boundary conditions. We find that if the particle shapes satisfy a partition of unity property, the particle charge deposited on the grid is conserved exactly. Further, if the particle shape is expressed as the convolution of a kernel with another kernel that satisfies the partition of unity, then the particle shape obeys the partition of unity. This property holds for kernels of arbitrary width, including widths that are not integer multiples of the grid spacing. Furthermore, we show results relaxing the approximations used to do BVO optimization analytically, by doing numerical computations of the total error as a function of the kernel width, on a grid in x. The comparison between numerical and analytical results shows good agreement over a range of particle shapes. We discuss the practical implications of our results, including the criteria for design and implementation of computationally efficient particle shapes that take advantage of the developed theory.},
doi = {10.1016/j.jcp.2021.110394},
journal = {Journal of Computational Physics},
number = ,
volume = 440,
place = {United States},
year = {Wed May 05 00:00:00 EDT 2021},
month = {Wed May 05 00:00:00 EDT 2021}
}

Works referenced in this record:

A fully nonlinear characteristic method for gyrokinetic simulation
journal, January 1993

  • Parker, S. E.; Lee, W. W.
  • Physics of Fluids B: Plasma Physics, Vol. 5, Issue 1
  • DOI: 10.1063/1.860870

Kinetic theory for fluctuations and noise in computer simulation of plasma
journal, January 1979


δf Algorithm
journal, July 1995

  • Denton, Richard E.; Kotschenreuther, M.
  • Journal of Computational Physics, Vol. 119, Issue 2
  • DOI: 10.1006/jcph.1995.1136

Generalized weighting scheme for δ f particle‐simulation method
journal, April 1994

  • Hu, Genze; Krommes, John A.
  • Physics of Plasmas, Vol. 1, Issue 4
  • DOI: 10.1063/1.870745

Non-Parametric Estimation of a Multivariate Probability Density
journal, January 1969

  • Epanechnikov, V. A.
  • Theory of Probability & Its Applications, Vol. 14, Issue 1
  • DOI: 10.1137/1114019

Constraint Ornstein-Uhlenbeck bridges
journal, September 2017

  • Mazzolo, Alain
  • Journal of Mathematical Physics, Vol. 58, Issue 9
  • DOI: 10.1063/1.5000077

Optimal Approximations of Transport Equations by Particle and Pseudoparticle Methods
journal, January 2000


GEMPIC: geometric electromagnetic particle-in-cell methods
journal, July 2017

  • Kraus, Michael; Kormann, Katharina; Morrison, Philip J.
  • Journal of Plasma Physics, Vol. 83, Issue 4
  • DOI: 10.1017/S002237781700040X

Computer Experiment of Anomalous Diffusion
journal, January 1966


The energy conserving particle-in-cell method
journal, August 2011


Comments on: The Maxwell-Vlasov equations as a continuous hamiltonian system
journal, November 1981


Clouds-in-clouds, clouds-in-cells physics for many-body plasma simulation
journal, April 1969


An energy- and charge-conserving, implicit, electrostatic particle-in-cell algorithm
journal, August 2011


The Maxwell-Vlasov equations as a continuous hamiltonian system
journal, December 1980


Variational formulation of particle algorithms for kinetic plasma simulations
journal, July 2013


Geometric integration of the Vlasov-Maxwell system with a variational particle-in-cell scheme
journal, August 2012

  • Squire, J.; Qin, H.; Tang, W. M.
  • Physics of Plasmas, Vol. 19, Issue 8
  • DOI: 10.1063/1.4742985

Reducing noise for PIC simulations using kernel density estimation algorithm
journal, October 2018


Variational Formulation of Macroparticle Models for Electromagnetic Plasma Simulations
journal, June 2014

  • Stamm, Alexander B.; Shadwick, Bradley A.; Evstatiev, Evstati G.
  • IEEE Transactions on Plasma Science, Vol. 42, Issue 6
  • DOI: 10.1109/TPS.2014.2320461

Energy-conserving numerical approximations for Vlasov plasmas
journal, August 1970


FLIP: A method for adaptively zoned, particle-in-cell calculations of fluid flows in two dimensions
journal, August 1986


Variational formulation of macro-particle plasma simulation algorithms
journal, May 2014

  • Shadwick, B. A.; Stamm, A. B.; Evstatiev, E. G.
  • Physics of Plasmas, Vol. 21, Issue 5
  • DOI: 10.1063/1.4874338

Theory of Plasma Simulation Using Finite-Size Particles
journal, January 1970


Collisional delta- f scheme with evolving background for transport time scale simulations
journal, December 1999

  • Brunner, S.; Valeo, E.; Krommes, J. A.
  • Physics of Plasmas, Vol. 6, Issue 12
  • DOI: 10.1063/1.873738

Particle simulation of plasmas
journal, April 1983


FLIP: A method for adaptively zoned, particle-in-cell calculations of fluid flows in two dimensions
journal, August 1986


The energy conserving particle-in-cell method
journal, August 2011