Title: Efficient data acquisition and training of collisional-radiative model artificial neural network surrogates through adaptive parameter space sampling

Journal Article · · Machine Learning: Science and Technology

Abstract Effective plasma transport modeling of magnetically confined fusion devices relies on having an accurate understanding of the ion composition and radiative power losses of the plasma. Generally, these quantities can be obtained from solutions of a collisional-radiative (CR) model at each time step within a plasma transport simulation. However, even compact, approximate CR models can be computationally onerous to evaluate, and in-situ evaluation of these models within a larger plasma transport code can lead to a rigid bottleneck. As a way to bypass this bottleneck, we propose deploying artificial neural network (ANN) surrogates to allow rapid evaluation of the necessary plasma quantities. However, one issue with training an accurate ANN surrogate is the reliance on a sufficiently large and representative training and validation data set, which can be time-consuming to generate. In this work we explore a data-driven active learning and training routine to allow autonomous adaptive sampling of the problem parameter space to ensure a sufficiently large and meaningful set of training data is assembled for the network training. As a result, we can demonstrate approximately order-of-magnitude savings in required training data samples to produce an accurate surrogate.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC); USDOE Office of Science (SC), Fusion Energy Sciences (FES)
Grant/Contract Number:
89233218CNA000001; AC02-06CH11357
OSTI ID:
1891575
Report Number(s):
LA-UR-21-31682
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 4 Vol. 3; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (39)

Deep Learning Spectroscopy: Neural Networks for Molecular Excitation Spectra journal January 2019
Approximation by superpositions of a sigmoidal function journal December 1989
The elements of statistical learning: data mining, inference and prediction journal March 2005
Advancing Fusion with Machine Learning Research Needs Workshop Report journal August 2020
The use of artificial neural networks in plasma spectroscopy journal January 1994
Application of the collisional-radiative, atomic-molecular model to the recombining divertor plasma journal November 1996
Multilayer feedforward networks are universal approximators journal January 1989
Disruption mitigation with high-pressure noble gas injection journal March 2003
A design study for an advanced divertor for DIII-D and ITER: the radiative slot divertor journal December 1992
FLYCHK: Generalized population kinetics and spectral model for rapid spectroscopic analysis for all elements journal December 2005
Disruptions in ITER and strategies for their control and mitigation journal August 2015
Generalized collision operator for fast electrons interacting with partially ionized impurities journal November 2018
Random Forests journal January 2001
Predicting disruptive instabilities in controlled fusion plasmas through deep learning journal April 2019
Artificial neural networks for plasma x‐ray spectroscopic analysis journal October 1992
Runaway electron production in DIII-D killer pellet experiments, calculated with the CQL3D/KPRAD model journal November 2000
Atomic Data and Modelling for Fusion: the ADAS Project
  • Summers, H. P.; O’Mullane, M. G.
  • 7TH INTERNATIONAL CONFERENCE ON ATOMIC AND MOLECULAR DATA AND THEIR APPLICATIONS - ICAMDATA-2010, AIP Conference Proceedings https://doi.org/10.1063/1.3585817
conference January 2011
Study of argon expulsion from the post-disruption runaway electron plateau following low-Z massive gas injection in DIII-D journal April 2020
Impact of a minority relativistic electron tail interacting with a thermal plasma containing high-atomic-number impurities journal April 2020
Deep learning for NLTE spectral opacities journal May 2020
Deep learning surrogate model for kinetic Landau-fluid closure with collision journal July 2020
Effects of nitrogen seeding in a tokamak plasma journal December 2020
Progress Toward Interpretable Machine Learning–Based Disruption Predictors Across Tokamaks journal September 2020
Chapter 1: Overview and summary journal December 1999
Calculation of the radiative cooling coefficient for krypton in a low density plasma journal April 2000
Chapter 1: Overview and summary journal June 2007
Melt damage to the JET ITER-like Wall and divertor journal January 2016
A Calculation of the Instantaneous Population Densities of the Excited Levels of Hydrogen-like Ions in a Plasma journal November 1963
Impurity seeding for tokamak power exhaust: from present devices via ITER to DEMO journal November 2013
The Los Alamos suite of relativistic atomic physics codes journal May 2015
A neural network model relating extraction current characteristics with optical emission spectra for the purpose of a digital twin of miniaturized ion thrusters journal April 2022
Phase-space dynamics of runaway electrons in magnetic fields journal February 2017
Avalanche mechanism for runaway electron amplification in a tokamak plasma journal April 2019
3D two-temperature magnetohydrodynamic modeling of fast thermal quenches due to injected impurities in tokamaks journal November 2018
Progress in disruption prevention for ITER journal June 2019
Analysis of Spectra from Laser Produced Plasmas Using a Neural Network journal September 1994
Neural Network Differential Equation and Plasma Equilibrium Solver journal November 1995
Universal approximation bounds for superpositions of a sigmoidal function journal May 1993
The feasibility of using neural networks to obtain cross sections from electron swarm data journal April 1991