Validation metrics for turbulent plasma transport

doi:10.1063/1.4954151

Title: Validation metrics for turbulent plasma transport

Journal Article · Wed Jun 15 00:00:00 EDT 2016 · Physics of Plasmas

DOI:https://doi.org/10.1063/1.4954151· OSTI ID:22598964

Holland, C., E-mail: chholland@ucsd.edu ^[1]

Center for Energy Research, University of California, San Diego, La Jolla, California 92093-0417 (United States)

Developing accurate models of plasma dynamics is essential for confident predictive modeling of current and future fusion devices. In modern computer science and engineering, formal verification and validation processes are used to assess model accuracy and establish confidence in the predictive capabilities of a given model. This paper provides an overview of the key guiding principles and best practices for the development of validation metrics, illustrated using examples from investigations of turbulent transport in magnetically confined plasmas. Particular emphasis is given to the importance of uncertainty quantification and its inclusion within the metrics, and the need for utilizing synthetic diagnostics to enable quantitatively meaningful comparisons between simulation and experiment. As a starting point, the structure of commonly used global transport model metrics and their limitations is reviewed. An alternate approach is then presented, which focuses upon comparisons of predicted local fluxes, fluctuations, and equilibrium gradients against observation. The utility of metrics based upon these comparisons is demonstrated by applying them to gyrokinetic predictions of turbulent transport in a variety of discharges performed on the DIII-D tokamak [J. L. Luxon, Nucl. Fusion 42, 614 (2002)], as part of a multi-year transport model validation activity.

Cite

Export

Save

OSTI ID:: 22598964

Journal Information:: Physics of Plasmas, Vol. 23, Issue 6; Other Information: (c) 2016 Author(s); Country of input: International Atomic Energy Agency (IAEA); ISSN 1070-664X

Country of Publication:: United States

Language:: English

References (118)

Modelling of JET Diagnostics Using Bayesian Graphical Models Svensson, J.; Ford, O.; McDonald, D. C. Contributions to Plasma Physics, Vol. 51, Issue 2-3 https://doi.org/10.1002/ctpp.201000058	journal	March 2011
An introduction to ROC analysis Fawcett, Tom Pattern Recognition Letters, Vol. 27, Issue 8 https://doi.org/10.1016/j.patrec.2005.10.010	journal	June 2006
Summarizing multiple aspects of model performance in a single diagram Taylor, Karl E. Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7 https://doi.org/10.1029/2000JD900719	journal	April 2001
Comparing simulation of plasma turbulence with experiment Ross, David W.; Bravenec, Ronald V.; Dorland, William Physics of Plasmas, Vol. 9, Issue 1 https://doi.org/10.1063/1.1424925	journal	January 2002
Comparing simulation of plasma turbulence with experiment. II. Gyrokinetic simulations Ross, David W.; Dorland, William Physics of Plasmas, Vol. 9, Issue 12 https://doi.org/10.1063/1.1518997	journal	December 2002
Heating and current drive by electron cyclotron waves Prater, R. Physics of Plasmas, Vol. 11, Issue 5 https://doi.org/10.1063/1.1690762	journal	May 2004
Role of trapped electron mode turbulence in internal transport barrier control in the Alcator C-Mod Tokamak Ernst, D. R.; Bonoli, P. T.; Catto, P. J. Physics of Plasmas, Vol. 11, Issue 5 https://doi.org/10.1063/1.1705653	journal	May 2004
System for simulating fluctuation diagnostics for application to turbulence computations Bravenec, R. V.; Nevins, W. M. Review of Scientific Instruments, Vol. 77, Issue 1 https://doi.org/10.1063/1.2151857	journal	January 2006
High sensitivity beam emission spectroscopy for core plasma turbulence imaging (invited) McKee, G. R.; Fonck, R. J.; Gupta, D. K. Review of Scientific Instruments, Vol. 77, Issue 10 https://doi.org/10.1063/1.2219429	journal	October 2006
Spatial transfer function for the beam emission spectroscopy diagnostic on DIII-D Shafer, M. W.; Fonck, R. J.; McKee, G. R. Review of Scientific Instruments, Vol. 77, Issue 10 https://doi.org/10.1063/1.2221908	journal	October 2006
Nonlocal neoclassical transport in tokamak and spherical torus experiments Wang, W. X.; Rewoldt, G.; Tang, W. M. Physics of Plasmas, Vol. 13, Issue 8 https://doi.org/10.1063/1.2244532	journal	August 2006
A theory-based transport model with comprehensive physics Staebler, G. M.; Kinsey, J. E.; Waltz, R. E. Physics of Plasmas, Vol. 14, Issue 5 https://doi.org/10.1063/1.2436852	journal	May 2007
A new gyrokinetic quasilinear transport model applied to particle transport in tokamak plasmas Bourdelle, C.; Garbet, X.; Imbeaux, F. Physics of Plasmas, Vol. 14, Issue 11 https://doi.org/10.1063/1.2800869	journal	November 2007
Lower hybrid current drive experiments on Alcator C-Mod: Comparison with theory and simulation Bonoli, P. T.; Ko, J.; Parker, R. Physics of Plasmas, Vol. 15, Issue 5 https://doi.org/10.1063/1.2904569	journal	May 2008
Fast electron bremsstrahlung in axisymmetric magnetic configuration Peysson, Y.; Decker, J. Physics of Plasmas, Vol. 15, Issue 9 https://doi.org/10.1063/1.2981391	journal	September 2008
Multiscale features of density and frequency spectra from nonlinear gyrokinetics Görler, T.; Jenko, F. Physics of Plasmas, Vol. 15, Issue 10 https://doi.org/10.1063/1.3006086	journal	October 2008
Verification and validation for magnetic fusion Greenwald, Martin Physics of Plasmas, Vol. 17, Issue 5 https://doi.org/10.1063/1.3298884	journal	May 2010
Direct multiscale coupling of a transport code to gyrokinetic turbulence codes Barnes, M.; Abel, I. G.; Dorland, W. Physics of Plasmas, Vol. 17, Issue 5 https://doi.org/10.1063/1.3323082	journal	May 2010
Measurements of the cross-phase angle between density and electron temperature fluctuations and comparison with gyrokinetic simulations White, A. E.; Peebles, W. A.; Rhodes, T. L. Physics of Plasmas, Vol. 17, Issue 5 https://doi.org/10.1063/1.3323084	journal	May 2010
Damped eigenmode saturation in plasma fluid turbulence Makwana, K. D.; Terry, P. W.; Kim, J. -H. Physics of Plasmas, Vol. 18, Issue 1 https://doi.org/10.1063/1.3530186	journal	January 2011
Comparison of scrape-off layer turbulence simulations with experiments using a synthetic gas puff imaging diagnostic Russell, D. A.; Myra, J. R.; D’Ippolito, D. A. Physics of Plasmas, Vol. 18, Issue 2 https://doi.org/10.1063/1.3553024	journal	February 2011
Advances in validating gyrokinetic turbulence models against L- and H-mode plasmas Holland, C.; Schmitz, L.; Rhodes, T. L. Physics of Plasmas, Vol. 18, Issue 5 https://doi.org/10.1063/1.3574518	journal	May 2011
2D properties of core turbulence on DIII-D and comparison to gyrokinetic simulations Shafer, M. W.; Fonck, R. J.; McKee, G. R. Physics of Plasmas, Vol. 19, Issue 3 https://doi.org/10.1063/1.3691965	journal	March 2012
Simulation of microtearing turbulence in national spherical torus experiment Guttenfelder, W.; Candy, J.; Kaye, S. M. Physics of Plasmas, Vol. 19, Issue 5 https://doi.org/10.1063/1.3694104	journal	May 2012
Verification and validation of linear gyrokinetic simulation of Alfvén eigenmodes in the DIII-D tokamak Spong, D. A.; Bass, E. M.; Deng, W. Physics of Plasmas, Vol. 19, Issue 8 https://doi.org/10.1063/1.4747505	journal	August 2012
Physics basis of Multi-Mode anomalous transport module Rafiq, T.; Kritz, A. H.; Weiland, J. Physics of Plasmas, Vol. 20, Issue 3 https://doi.org/10.1063/1.4794288	journal	March 2013
Full-F gyrofluid model Madsen, Jens Physics of Plasmas, Vol. 20, Issue 7 https://doi.org/10.1063/1.4813241	journal	July 2013
Review of recent experimental and modeling progress in the lower hybrid range of frequencies at ITER relevant parameters Bonoli, Paul T. Physics of Plasmas, Vol. 21, Issue 6 https://doi.org/10.1063/1.4884360	journal	June 2014
Edge-localized-modes in tokamaks Leonard, A. W. Physics of Plasmas, Vol. 21, Issue 9 https://doi.org/10.1063/1.4894742	journal	September 2014
Study of the L-mode tokamak plasma “shortfall” with local and global nonlinear gyrokinetic δf particle-in-cell simulation Chowdhury, J.; Wan, Weigang; Chen, Yang Physics of Plasmas, Vol. 21, Issue 11 https://doi.org/10.1063/1.4901031	journal	November 2014
Synergistic cross-scale coupling of turbulence in a tokamak plasma Howard, N. T.; Holland, C.; White, A. E. Physics of Plasmas, Vol. 21, Issue 11 https://doi.org/10.1063/1.4902366	journal	November 2014
Approaching the investigation of plasma turbulence through a rigorous verification and validation procedure: A practical examplea) Ricci, P.; Riva, F.; Theiler, C. Physics of Plasmas, Vol. 22, Issue 5 https://doi.org/10.1063/1.4919276	journal	May 2015
Nonlinear gyrokinetic simulations of the I-mode high confinement regime and comparisons with experimenta) White, A. E.; Howard, N. T.; Creely, A. J. Physics of Plasmas, Vol. 22, Issue 5 https://doi.org/10.1063/1.4921150	journal	May 2015
Fluid models of phase mixing, Landau damping, and nonlinear gyrokinetic dynamics Hammett, G. W.; Dorland, W.; Perkins, F. W. Physics of Fluids B: Plasma Physics, Vol. 4, Issue 7 https://doi.org/10.1063/1.860014	journal	March 1992
Gyro‐Landau fluid models for toroidal geometry Waltz, R. E.; Dominguez, R. R.; Hammett, G. W. Physics of Fluids B: Plasma Physics, Vol. 4, Issue 10 https://doi.org/10.1063/1.860422	journal	October 1992
Effect of finite aspect ratio on the neoclassical ion thermal conductivity in the banana regime Chang, C. S. Physics of Fluids, Vol. 25, Issue 9 https://doi.org/10.1063/1.863934	journal	January 1982
Toroidal gyrofluid equations for simulations of tokamak turbulence Beer, M. A.; Hammett, G. W. Physics of Plasmas, Vol. 3, Issue 11 https://doi.org/10.1063/1.871538	journal	November 1996
A gyro-Landau-fluid transport model Waltz, R. E.; Staebler, G. M.; Dorland, W. Physics of Plasmas, Vol. 4, Issue 7 https://doi.org/10.1063/1.872228	journal	July 1997
Effects of E×B velocity shear and magnetic shear on turbulence and transport in magnetic confinement devices Burrell, K. H. Physics of Plasmas, Vol. 4, Issue 5 https://doi.org/10.1063/1.872367	journal	May 1997
The behaviour of fast ions in tokamak experiments Heidbrink, W. W.; Sadler, G. J. Nuclear Fusion, Vol. 35, Issue 2 https://doi.org/10.1088/0029-5515/35/2/514	journal	February 1995
Chapter 1: Overview and summary Editors, ITER Physics Basis; Co-Chairs, ITER Physics Expert Group Chairs an; Unit, ITER Joint Central Team and Physics Nuclear Fusion, Vol. 39, Issue 12 https://doi.org/10.1088/0029-5515/39/12/301	journal	December 1999
Predictive capability of MHD stability limits in high performance DIII-D discharges Turnbull, A. D.; Brennan, D. P.; Chu, M. S. Nuclear Fusion, Vol. 42, Issue 7 https://doi.org/10.1088/0029-5515/42/7/315	journal	July 2002
Benchmarking of codes for electron cyclotron heating and electron cyclotron current drive under ITER conditions Prater, R.; Farina, D.; Gribov, Yu. Nuclear Fusion, Vol. 48, Issue 3 https://doi.org/10.1088/0029-5515/48/3/035006	journal	January 2008
Full-f gyrokinetic particle simulation of centrally heated global ITG turbulence from magnetic axis to edge pedestal top in a realistic tokamak geometry Ku, S.; Chang, C. S.; Diamond, P. H. Nuclear Fusion, Vol. 49, Issue 11 https://doi.org/10.1088/0029-5515/49/11/115021	journal	September 2009
Validation studies of gyrofluid and gyrokinetic predictions of transport and turbulence stiffness using the DIII-D tokamak Holland, C.; Kinsey, J. E.; DeBoo, J. C. Nuclear Fusion, Vol. 53, Issue 8 https://doi.org/10.1088/0029-5515/53/8/083027	journal	July 2013
Ion temperature profile stiffness: non-linear gyrokinetic simulations and comparison with experiment Citrin, J.; Jenko, F.; Mantica, P. Nuclear Fusion, Vol. 54, Issue 2 https://doi.org/10.1088/0029-5515/54/2/023008	journal	February 2014
Determination of Z _eff by integrating measurements from x-ray tomography and charge exchange recombination spectroscopy Galante, M. E.; Reusch, L. M.; Den Hartog, D. J. Nuclear Fusion, Vol. 55, Issue 12 https://doi.org/10.1088/0029-5515/55/12/123016	journal	November 2015
Improved profile fitting and quantification of uncertainty in experimental measurements of impurity transport coefficients using Gaussian process regression Chilenski, M. A.; Greenwald, M.; Marzouk, Y. Nuclear Fusion, Vol. 55, Issue 2 https://doi.org/10.1088/0029-5515/55/2/023012	journal	January 2015
Multi-scale gyrokinetic simulation of tokamak plasmas: enhanced heat loss due to cross-scale coupling of plasma turbulence Howard, N. T.; Holland, C.; White, A. E. Nuclear Fusion, Vol. 56, Issue 1 https://doi.org/10.1088/0029-5515/56/1/014004	journal	December 2015
Transport simulation on L-mode and improved confinement associated with current profile modification Fukuyama, A.; Itoh, K.; Itoh, S. -I Plasma Physics and Controlled Fusion, Vol. 37, Issue 6 https://doi.org/10.1088/0741-3335/37/6/002	journal	June 1995
Ion cyclotron range of frequencies mode conversion electron heating in deuterium–hydrogen plasmas in the Alcator C-Mod tokamak Lin, Y.; Wukitch, S. J.; Bonoli, P. T. Plasma Physics and Controlled Fusion, Vol. 45, Issue 6 https://doi.org/10.1088/0741-3335/45/6/313	journal	May 2003
Edge radial electric field structure in quiescent H-mode plasmas in the DIII-D tokamak Burrell, K. H.; West, W. P.; Doyle, E. J. Plasma Physics and Controlled Fusion, Vol. 46, Issue 5A https://doi.org/10.1088/0741-3335/46/5a/018	journal	April 2004
Profile stiffness and global confinement Garbet, X.; Mantica, P.; Ryter, F. Plasma Physics and Controlled Fusion, Vol. 46, Issue 9 https://doi.org/10.1088/0741-3335/46/9/002	journal	July 2004
The effect of ion-scale dynamics on electron-temperature-gradient turbulence Candy, J.; Waltz, R. E.; Fahey, M. R. Plasma Physics and Controlled Fusion, Vol. 49, Issue 8 https://doi.org/10.1088/0741-3335/49/8/008	journal	July 2007
The European turbulence code benchmarking effort: turbulence driven by thermal gradients in magnetically confined plasmas Falchetto, G. L.; Scott, B. D.; Angelino, P. Plasma Physics and Controlled Fusion, Vol. 50, Issue 12 https://doi.org/10.1088/0741-3335/50/12/124015	journal	November 2008
Application of dimensionless parameter scaling techniques to the design and interpretation of magnetic fusion experiments Luce, T. C.; Petty, C. C.; Cordey, J. G. Plasma Physics and Controlled Fusion, Vol. 50, Issue 4 https://doi.org/10.1088/0741-3335/50/4/043001	journal	March 2008
Full linearized Fokker–Planck collisions in neoclassical transport simulations Belli, E. A.; Candy, J. Plasma Physics and Controlled Fusion, Vol. 54, Issue 1 https://doi.org/10.1088/0741-3335/54/1/015015	journal	December 2011
Simulation of plasma turbulence in scrape-off layer conditions: the GBS code, simulation results and code validation Ricci, P.; Halpern, F. D.; Jolliet, S. Plasma Physics and Controlled Fusion, Vol. 54, Issue 12 https://doi.org/10.1088/0741-3335/54/12/124047	journal	November 2012
Impurity transport, turbulence transitions and intrinsic rotation in Alcator C-Mod plasmas Howard, N. T.; White, A. E.; Greenwald, M. Plasma Physics and Controlled Fusion, Vol. 56, Issue 12 https://doi.org/10.1088/0741-3335/56/12/124004	journal	November 2014
Time dependent evolution of RF-generated non-thermal particle distributions in fusion plasmas Wright, J. C.; Bader, A.; Berry, L. A. Plasma Physics and Controlled Fusion, Vol. 56, Issue 4 https://doi.org/10.1088/0741-3335/56/4/045007	journal	March 2014
Resonant magnetic perturbations of edge-plasmas in toroidal confinement devices Evans, T. E. Plasma Physics and Controlled Fusion, Vol. 57, Issue 12 https://doi.org/10.1088/0741-3335/57/12/123001	journal	November 2015
Fidelity of reduced and realistic electron mass ratio multi-scale gyrokinetic simulations of tokamak discharges Howard, N. T.; Holland, C.; White, A. E. Plasma Physics and Controlled Fusion, Vol. 57, Issue 6 https://doi.org/10.1088/0741-3335/57/6/065009	journal	April 2015
Validating simulations of core tokamak turbulence: current status and future directions Holland, C.; Candy, J.; Waltz, R. E. Journal of Physics: Conference Series, Vol. 125 https://doi.org/10.1088/1742-6596/125/1/012043	journal	July 2008
Fast Ion Induced Shearing of 2D Alfvén Eigenmodes Measured by Electron Cyclotron Emission Imaging Tobias, B. J.; Classen, I. G. J.; Domier, C. W. Physical Review Letters, Vol. 106, Issue 7 https://doi.org/10.1103/PhysRevLett.106.075003	journal	February 2011
Saturation of Gyrokinetic Turbulence through Damped Eigenmodes Hatch, D. R.; Terry, P. W.; Jenko, F. Physical Review Letters, Vol. 106, Issue 11 https://doi.org/10.1103/PhysRevLett.106.115003	journal	March 2011
Fluid moment models for Landau damping with application to the ion-temperature-gradient instability Hammett, Gregory W.; Perkins, Francis W. Physical Review Letters, Vol. 64, Issue 25 https://doi.org/10.1103/PhysRevLett.64.3019	journal	June 1990
Radial Structure of Alfvén Eigenmodes in the DIII-D Tokamak through Electron-Cyclotron-Emission Measurements Van Zeeland, M. A.; Kramer, G. J.; Austin, M. E. Physical Review Letters, Vol. 97, Issue 13 https://doi.org/10.1103/PhysRevLett.97.135001	journal	September 2006
Comprehensive Approach to Verification and Validation of CFD Simulations—Part 1: Methodology and Procedures Stern, Fred; Wilson, Robert V.; Coleman, Hugh W. Journal of Fluids Engineering, Vol. 123, Issue 4 https://doi.org/10.1115/1.1412235	journal	July 2001
Toward a Better Understanding of Model Validation Metrics Liu, Yu; Chen, Wei; Arendt, Paul Journal of Mechanical Design, Vol. 133, Issue 7 https://doi.org/10.1115/1.4004223	journal	July 2011
Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics Najm, Habib N. Annual Review of Fluid Mechanics, Vol. 41, Issue 1 https://doi.org/10.1146/annurev.fluid.010908.165248	journal	January 2009
Computation-Communication Overlap Techniques for Parallel Spectral Calculations in Gyrokinetic Vlasov Simulations Maeyama, Shinya; Watanabe, Tomohiko; Idomura, Yasuhiro Plasma and Fusion Research, Vol. 8, Issue 0 https://doi.org/10.1585/pfr.8.1403150	journal	January 2013
The Homogeneous Chaos Wiener, Norbert American Journal of Mathematics, Vol. 60, Issue 4 https://doi.org/10.2307/2371268	journal	October 1938
A global collisionless PIC code in magnetic coordinates Jolliet, S.; Bottino, A.; Angelino, P. Computer Physics Communications, Vol. 177, Issue 5 https://doi.org/10.1016/j.cpc.2007.04.006	journal	September 2007
Electrostatic turbulence and transport in a simple magnetized plasma Fasoli, A.; Labit, B.; McGrath, M. Physics of Plasmas, Vol. 13, Issue 5 https://doi.org/10.1063/1.2178773	journal	May 2006
Fast-ion Dα measurements of the fast-ion distribution (invited) Heidbrink, W. W. Review of Scientific Instruments, Vol. 81, Issue 10 https://doi.org/10.1063/1.3478739	journal	October 2010
Derivation via free energy conservation constraints of gyrofluid equations with finite-gyroradius electromagnetic nonlinearities Scott, B. Physics of Plasmas, Vol. 17, Issue 10 https://doi.org/10.1063/1.3484219	journal	October 2010
Electron profile stiffness and critical gradient studies DeBoo, J. C.; Petty, C. C.; White, A. E. Physics of Plasmas, Vol. 19, Issue 8 https://doi.org/10.1063/1.4750061	journal	August 2012
Review of recent experimental and modeling progress in the lower hybrid range of frequencies at ITER relevant parameters Bonoli, Paul T. RADIOFREQUENCY POWER IN PLASMAS: Proceedings of the 20th Topical Conference, AIP Conference Proceedings https://doi.org/10.1063/1.4864497	conference	January 2014
Comparisons and physics basis of tokamak transport models and turbulence simulations Dimits, A. M.; Bateman, G.; Beer, M. A. Physics of Plasmas, Vol. 7, Issue 3 https://doi.org/10.1063/1.873896	journal	March 2000
Electron temperature gradient driven turbulence Jenko, F.; Dorland, W.; Kotschenreuther, M. Physics of Plasmas, Vol. 7, Issue 5 https://doi.org/10.1063/1.874014	journal	May 2000
Chapter 2: Plasma confinement and transport Transport, ITER Physics Expert Group on Confin; Database, ITER Physics Expert Group on Confin; Editors, ITER Physics Basis Nuclear Fusion, Vol. 39, Issue 12 https://doi.org/10.1088/0029-5515/39/12/302	journal	December 1999
First scenario development with the JET new ITER-like wall Joffrin, E.; Baruzzo, M.; Beurskens, M. Nuclear Fusion, Vol. 54, Issue 1 https://doi.org/10.1088/0029-5515/54/1/013011	journal	December 2013
Turbulent Transport Reduction by Zonal Flows: Massively Parallel Simulations Lin, Z. Science, Vol. 281, Issue 5384 https://doi.org/10.1126/science.281.5384.1835	journal	September 1998
Quantification of Uncertainty in Computational Fluid Dynamics Roache, P. J. Annual Review of Fluid Mechanics, Vol. 29, Issue 1 https://doi.org/10.1146/annurev.fluid.29.1.123	journal	January 1997
Local transport in Joint European Tokamak edge-localized, high-confinement mode plasmas with H, D, DT, and T isotopes Budny, R. V.; Ernst, D. R.; Hahm, T. S. Physics of Plasmas, Vol. 7, Issue 12 https://doi.org/10.1063/1.1320466	journal	December 2000
Validation in fusion research: Towards guidelines and best practices Terry, P. W.; Greenwald, M.; Leboeuf, J. -N. Physics of Plasmas, Vol. 15, Issue 6 https://doi.org/10.1063/1.2928909	journal	June 2008
Gyrofluid turbulence models with kinetic effects Dorland, W.; Hammett, G. W. Physics of Fluids B: Plasma Physics, Vol. 5, Issue 3 https://doi.org/10.1063/1.860934	journal	March 1993
Nonlinear electromagnetic gyrokinetic equation for plasmas with large mean flows Sugama, H.; Horton, W. Physics of Plasmas, Vol. 5, Issue 7 https://doi.org/10.1063/1.872941	journal	July 1998
Reduced electron thermal transport in low collisionality H-mode plasmas in DIII-D and the importance of TEM/ETG-scale turbulence Schmitz, L.; Holland, C.; Rhodes, T. L. Nuclear Fusion, Vol. 52, Issue 2 https://doi.org/10.1088/0029-5515/52/2/023003	journal	January 2012
Trapped electron mode driven electron heat transport in JET: experimental investigation and gyro-kinetic theory validation Bonanomi, N.; Mantica, P.; Szepesi, G. Nuclear Fusion, Vol. 55, Issue 11 https://doi.org/10.1088/0029-5515/55/11/113016	journal	September 2015
Electron temperature critical gradient and transport stiffness in DIII-D Smith, S. P.; Petty, C. C.; White, A. E. Nuclear Fusion, Vol. 55, Issue 8 https://doi.org/10.1088/0029-5515/55/8/083011	journal	July 2015
Global full- f gyrokinetic simulations of plasma turbulence Grandgirard, V.; Sarazin, Y.; Angelino, P. Plasma Physics and Controlled Fusion, Vol. 49, Issue 12B https://doi.org/10.1088/0741-3335/49/12b/s16	journal	November 2007
Kinetic calculation of neoclassical transport including self-consistent electron and impurity dynamics Belli, E. A.; Candy, J. Plasma Physics and Controlled Fusion, Vol. 50, Issue 9 https://doi.org/10.1088/0741-3335/50/9/095010	journal	July 2008
Profile stiffness and global confinement Garbet, X.; Mantica, P.; Ryter, F. Plasma Physics and Controlled Fusion, Vol. 47, Issue 6 https://doi.org/10.1088/0741-3335/47/6/014	journal	May 2005
Electromagnetic stabilization of tokamak microturbulence in a high- β regime Citrin, J.; Garcia, J.; Görler, T. Plasma Physics and Controlled Fusion, Vol. 57, Issue 1 https://doi.org/10.1088/0741-3335/57/1/014032	journal	November 2014
The nonlinear gyro-kinetic flux tube code GKW Peeters, A. G.; Camenen, Y.; Casson, F. J. Computer Physics Communications, Vol. 180, Issue 12 https://doi.org/10.1016/j.cpc.2009.07.001	journal	December 2009
A Landau fluid model for electromagnetic plasma microturbulence Snyder, P. B.; Hammett, G. W. Physics of Plasmas, Vol. 8, Issue 7 https://doi.org/10.1063/1.1374238	journal	July 2001
Comparison of turbulence measurements from DIII-D low-mode and high-performance plasmas to turbulence simulations and models Rhodes, T. L.; Leboeuf, J. -N.; Sydora, R. D. Physics of Plasmas, Vol. 9, Issue 5 https://doi.org/10.1063/1.1464544	journal	May 2002
Gyro-Landau fluid equations for trapped and passing particles Staebler, G. M.; Kinsey, J. E.; Waltz, R. E. Physics of Plasmas, Vol. 12, Issue 10 https://doi.org/10.1063/1.2044587	journal	October 2005
Role of stable eigenmodes in saturated local plasma turbulence Terry, P. W.; Baver, D. A.; Gupta, Sangeeta Physics of Plasmas, Vol. 13, Issue 2 https://doi.org/10.1063/1.2168453	journal	February 2006
Coupled ion temperature gradient and trapped electron mode to electron temperature gradient mode gyrokinetic simulations Waltz, R. E.; Candy, J.; Fahey, M. Physics of Plasmas, Vol. 14, Issue 5 https://doi.org/10.1063/1.2436851	journal	May 2007
Measurements of core electron temperature and density fluctuations in DIII-D and comparison to nonlinear gyrokinetic simulations White, A. E.; Schmitz, L.; McKee, G. R. Physics of Plasmas, Vol. 15, Issue 5 https://doi.org/10.1063/1.2895408	journal	May 2008
Langmuir probe-based observables for plasma-turbulence code validation and application to the TORPEX basic plasma physics experiment Ricci, Paolo; Theiler, C.; Fasoli, A. Physics of Plasmas, Vol. 16, Issue 5 https://doi.org/10.1063/1.3082698	journal	May 2009
Tokamak profile prediction using direct gyrokinetic and neoclassical simulation Candy, J.; Holland, C.; Waltz, R. E. Physics of Plasmas, Vol. 16, Issue 6 https://doi.org/10.1063/1.3167820	journal	June 2009
Multi-scale gyrokinetic simulation of Alcator C-Mod tokamak discharges Howard, N. T.; White, A. E.; Greenwald, M. Physics of Plasmas, Vol. 21, Issue 3 https://doi.org/10.1063/1.4869078	journal	March 2014
A flux-matched gyrokinetic analysis of DIII-D L-mode turbulence Görler, T.; White, A. E.; Told, D. Physics of Plasmas, Vol. 21, Issue 12 https://doi.org/10.1063/1.4904301	journal	December 2014
Gyrokinetic studies of core turbulence features in ASDEX Upgrade H-mode plasmas Navarro, A. Bañón; Happel, T.; Görler, T. Physics of Plasmas, Vol. 22, Issue 4 https://doi.org/10.1063/1.4919022	journal	April 2015
3D toroidal physics: Testing the boundaries of symmetry breakinga) Spong, Donald A. Physics of Plasmas, Vol. 22, Issue 5 https://doi.org/10.1063/1.4921255	journal	May 2015
Nonlinear gyrokinetic equations for low-frequency electromagnetic waves in general plasma equilibria Frieman, E. A. Physics of Fluids, Vol. 25, Issue 3 https://doi.org/10.1063/1.863762	journal	January 1982
Bootstrap current and neoclassical transport in tokamaks of arbitrary collisionality and aspect ratio Houlberg, W. A.; Shaing, K. C.; Hirshman, S. P. Physics of Plasmas, Vol. 4, Issue 9 https://doi.org/10.1063/1.872465	journal	September 1997
Chapter 3: MHD stability, operational limits and disruptions Mhd, ITER Physics Expert Group on Disrup; Editors, ITER Physics Basis Nuclear Fusion, Vol. 39, Issue 12 https://doi.org/10.1088/0029-5515/39/12/303	journal	December 1999
L-mode validation studies of gyrokinetic turbulence simulations via multiscale and multifield turbulence measurements on the DIII-D tokamak Rhodes, T. L.; Holland, C.; Smith, S. P. Nuclear Fusion, Vol. 51, Issue 6 https://doi.org/10.1088/0029-5515/51/6/063022	journal	May 2011
A unified method for operator evaluation in local Grad–Shafranov plasma equilibria Candy, J. Plasma Physics and Controlled Fusion, Vol. 51, Issue 10 https://doi.org/10.1088/0741-3335/51/10/105009	journal	September 2009
Electrostatic instabilities, turbulence and fast ion interactions in the TORPEX device Fasoli, A.; Burckel, A.; Federspiel, L. Plasma Physics and Controlled Fusion, Vol. 52, Issue 12 https://doi.org/10.1088/0741-3335/52/12/124020	journal	November 2010
Investigation of fast particle driven instabilities by 2D electron cyclotron emission imaging on ASDEX Upgrade Classen, I. G. J.; Lauber, Ph; Curran, D. Plasma Physics and Controlled Fusion, Vol. 53, Issue 12 https://doi.org/10.1088/0741-3335/53/12/124018	journal	November 2011
Verification, validation, and predictive capability in computational engineering and physics Oberkampf, William L.; Trucano, Timothy G.; Hirsch, Charles Applied Mechanics Reviews, Vol. 57, Issue 5 https://doi.org/10.1115/1.1767847	journal	September 2004
On the Validation of Gyrokinetic L-Mode Simulations Görler, T.; White, A. E.; Told, D. Fusion Science and Technology, Vol. 69, Issue 2 https://doi.org/10.13182/fst15-182	journal	April 2016
Validation in Fusion Research: Towards Guidelines and Best Practices Terry, P. W.; Greenwald, M.; Leboeuf, J. -N. arXiv https://doi.org/10.48550/arxiv.0801.2787	text	January 2008

Cited By (23)

Correlation electron cyclotron emission diagnostic and improved calculation of turbulent temperature fluctuation levels on ASDEX Upgrade Creely, A. J.; Freethy, S. J.; Burke, W. M. Review of Scientific Instruments, Vol. 89, Issue 5 https://doi.org/10.1063/1.5005507	journal	May 2018
Validation of gyrokinetic simulations with measurements of electron temperature fluctuations and density-temperature phase angles on ASDEX Upgrade Freethy, S. J.; Görler, T.; Creely, A. J. Physics of Plasmas, Vol. 25, Issue 5 https://doi.org/10.1063/1.5018930	journal	May 2018
Fast synthetic X-mode Doppler reflectometry diagnostics for the full-f global gyrokinetic modeling of the FT-2 tokamak Altukhov, A. B.; Gurchenko, A. D.; Gusakov, E. Z. Physics of Plasmas, Vol. 25, Issue 8 https://doi.org/10.1063/1.5034781	journal	August 2018
Experimental trends of reflectometry frequency spectra emerging from a systematic analysis of the Tore Supra database Sun, Y.; Sabot, R.; Heuraux, S. Physics of Plasmas, Vol. 26, Issue 3 https://doi.org/10.1063/1.5082953	journal	March 2019
Main-ion intrinsic toroidal rotation across the ITG/TEM boundary in DIII-D discharges during ohmic and electron cyclotron heating Grierson, B. A.; Chrystal, C.; Haskey, S. R. Physics of Plasmas, Vol. 26, Issue 4 https://doi.org/10.1063/1.5090505	journal	April 2019
Orchestrating TRANSP Simulations for Interpretative and Predictive Tokamak Modeling with OMFIT Grierson, B. A.; Yuan, X.; Gorelenkova, M. Fusion Science and Technology, Vol. 74, Issue 1-2 https://doi.org/10.1080/15361055.2017.1398585	journal	February 2018
Tractable flux-driven temperature, density, and rotation profile evolution with the quasilinear gyrokinetic transport model QuaLiKiz Citrin, J.; Bourdelle, C.; Casson, F. J. Plasma Physics and Controlled Fusion, Vol. 59, Issue 12 https://doi.org/10.1088/1361-6587/aa8aeb	journal	November 2017
Optimal MSE polarisation angle and q-profile estimation using Kalman filters and the plasma simulator RAPTOR Messmer, M. C. C.; Felici, F.; Sauter, O. Plasma Physics and Controlled Fusion, Vol. 61, Issue 3 https://doi.org/10.1088/1361-6587/aaf7ed	journal	February 2019
Real-time-capable prediction of temperature and density profiles in a tokamak using RAPTOR and a first-principle-based transport model Felici, F.; Citrin, J.; Teplukhina, A. A. Nuclear Fusion, Vol. 58, Issue 9 https://doi.org/10.1088/1741-4326/aac8f0	journal	July 2018
Validation study of GENE on ASDEX Upgrade using perturbative thermal diffusivity measured with partial sawtooth heat pulses Creely, A. J.; Görler, T.; Conway, G. D. Nuclear Fusion, Vol. 58, Issue 12 https://doi.org/10.1088/1741-4326/aadca1	journal	September 2018
A modern perspective on flow instability and shockwave phenomena in reacting gas multiphase system excited by direct current Kurbatov, Peter F. Physics of Fluids, Vol. 31, Issue 11 https://doi.org/10.1063/1.5126444	journal	November 2019
Validation of gyrokinetic simulations of a National Spherical Torus eXperiment H-mode plasma and comparisons with a high- k scattering synthetic diagnostic Ruiz, J. Ruiz; Guttenfelder, W.; White, A. E. Plasma Physics and Controlled Fusion, Vol. 61, Issue 11 https://doi.org/10.1088/1361-6587/ab4742	journal	October 2019
Validation of nonlinear gyrokinetic transport models using turbulence measurements White, A. E. Journal of Plasma Physics, Vol. 85, Issue 1 https://doi.org/10.1017/s0022377818001253	journal	February 2019
Propagation of input parameter uncertainties in transport models Vaezi, P.; Holland, C.; Grierson, B. A. Physics of Plasmas, Vol. 25, Issue 10 https://doi.org/10.1063/1.5053906	journal	October 2018
VITALS: A Surrogate-Based Optimization Framework for the Accelerated Validation of Plasma Transport Codes Rodriguez-Fernandez, P.; White, A. E.; Creely, A. J. Fusion Science and Technology, Vol. 74, Issue 1-2 https://doi.org/10.1080/15361055.2017.1396166	journal	February 2018
Comparison between measured and predicted turbulence frequency spectra in ITG and TEM regimes Citrin, J.; Arnichand, H.; Bernardo, J. Plasma Physics and Controlled Fusion, Vol. 59, Issue 6 https://doi.org/10.1088/1361-6587/aa6d1d	journal	May 2017
Criteria for the importance of multi-scale interactions in turbulent transport simulations Creely, A. J.; Rodriguez-Fernandez, P.; Conway, G. D. Plasma Physics and Controlled Fusion, Vol. 61, Issue 8 https://doi.org/10.1088/1361-6587/ab24ae	journal	June 2019
First principles of modelling the stabilization of microturbulence by fast ions Wilkie, G. J.; Iantchenko, A.; Abel, I. G. Nuclear Fusion, Vol. 58, Issue 8 https://doi.org/10.1088/1741-4326/aab727	journal	June 2018
Application of Gaussian process regression to plasma turbulent transport model validation via integrated modelling Ho, A.; Citrin, J.; Auriemma, F. Nuclear Fusion, Vol. 59, Issue 5 https://doi.org/10.1088/1741-4326/ab065a	journal	March 2019
Uncertainty propagation by using spectral methods: A practical application to a two-dimensional turbulence fluid model Riva, Fabio; Milanese, Lucio; Ricci, Paolo Physics of Plasmas, Vol. 24, Issue 10 https://doi.org/10.1063/1.4996445	journal	October 2017
Shaping effects on scrape-off layer plasma turbulence: A rigorous validation of three-dimensional simulations against TCV measurements Riva, F.; Tsui, C. K.; Boedo, J. A. Physics of Plasmas, Vol. 27, Issue 1 https://doi.org/10.1063/1.5123451	journal	January 2020
Tractable flux-driven temperature, density, and rotation profile evolution with the quasilinear gyrokinetic transport model QuaLiKiz Citrin, J.; Bourdelle, C.; Casson, F. J. arXiv https://doi.org/10.48550/arxiv.1708.01224	text	January 2017
Application of Gaussian process regression to plasma turbulent transport model validation via integrated modelling Ho, Aaron; Citrin, Jonathan; Auriemma, Fulvio arXiv https://doi.org/10.48550/arxiv.2105.01177	text	January 2021

Similar Records

Validation metrics for turbulent plasma transport

Journal Article · Wed Jun 01 00:00:00 EDT 2016 · Physics of Plasmas · OSTI ID:22598964

Holland, C.

Testing gyrokinetic simulations of electron turbulence

Journal Article · Fri Jun 01 00:00:00 EDT 2012 · Nuclear Fusion · OSTI ID:22598964

Holland, C.; DeBoo, J. C.; Rhodes, T. L.; +10 more

Implementation and application of two synthetic diagnostics for validating simulations of core tokamak turbulence

Journal Article · Fri May 15 00:00:00 EDT 2009 · Physics of Plasmas · OSTI ID:22598964

Holland, C; Tynan, G R; White, A E; +5 more

Related Subjects

70 PLASMA PHYSICS AND FUSION TECHNOLOGY
COMPARATIVE EVALUATIONS
COMPUTERIZED SIMULATION
DOUBLET-3 DEVICE
FLUCTUATIONS
METRICS
PLASMA
TRANSPORT THEORY
TURBULENT FLOW
VALIDATION

Title: Validation metrics for turbulent plasma transport

Citation Formats

References (118)

Cited By (23)

Similar Records

Related Subjects