DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep energy-pressure regression for a thermodynamically consistent EOS model

Journal Article · · Machine Learning: Science and Technology

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.

Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
NA0003856
OSTI ID:
2309795
Alternate ID(s):
OSTI ID: 2311833; OSTI ID: 2284010
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 1 Vol. 5; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (43)

Making inertial confinement fusion models more predictive journal August 2019
Machine learning of linear differential equations using Gaussian processes journal November 2017
Prediction of vegetation dynamics using NDVI time series data and LSTM journal February 2018
Overfitting and undercomputing in machine learning journal September 1995
Shock Compression of Liquid Deuterium up to 1 TPa journal June 2019
First-principles equation-of-state table of deuterium for inertial confinement fusion applications journal December 2011
Absolute Equation-of-State Measurement for Polystyrene from 25 to 60 Mbar Using a Spherically Converging Shock Wave journal July 2018
Physics-informed machine learning journal May 2021
A Review of Equation-of-State Models for Inertial Confinement Fusion Materials journal September 2018
Ab initio solution of the many-electron Schrödinger equation with deep neural networks journal September 2020
Artificial neural networks for solving ordinary and partial differential equations journal January 1998
Deep learning and process understanding for data-driven Earth system science journal February 2019
Neural network surrogate models for equations of state journal March 2023
Geometric Deep Learning: Going beyond Euclidean data journal July 2017
Deep learning journal May 2015
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries journal February 2021
Impact of first-principles properties of deuterium–tritium on inertial confinement fusion target designs journal April 2015
Transformers for modeling physical systems journal February 2022
Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks journal January 2020
On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks journal October 2021
Discovering Physical Concepts with Neural Networks journal January 2020
Equations of state for hydrogen and deuterium. report December 2003
Neural-net-induced Gaussian process regression for function approximation and PDE solution journal May 2019
Physically informed artificial neural networks for atomistic modeling of materials journal May 2019
Multiphase equation of state of hydrogen from ab initio calculations in the range 0.2 to 5 g/cc up to 10 eV journal March 2011
Physics‐Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems journal May 2020
Meta-GGA exchange-correlation free energy density functional to increase the accuracy of warm dense matter simulations journal February 2022
AB INITIO EQUATIONS OF STATE FOR HYDROGEN (H-REOS.3) AND HELIUM (He-REOS.3) AND THEIR IMPLICATIONS FOR THE INTERIOR OF BROWN DWARFS journal January 2014
First-principles equation of state of CHON resin for inertial confinement fusion applications journal October 2022
Machine Learning and Deep Learning frameworks and libraries for large-scale data mining: a survey journal January 2019
Design of inertial fusion implosions reaching the burning plasma regime journal January 2022
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators journal March 2021
High-precision equation of state benchmark for cryogenic liquid deuterium at ultrahigh pressure journal April 2021
Neural Networks and the Bias/Variance Dilemma journal January 1992
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations journal January 2020
Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data journal October 2019
High-Precision Shock Wave Measurements of Deuterium: Evaluation of Exchange-Correlation Functionals at the Molecular-to-Atomic Transition journal January 2017
A measurement of the equation of state of carbon envelopes of white dwarfs journal August 2020
Improved first-principles equation-of-state table of deuterium for high-energy-density applications journal October 2021
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Measurement of the sound speed in dense fluid deuterium along the cryogenic liquid Hugoniot journal January 2019
Numerical Gaussian Processes for Time-Dependent and Nonlinear Partial Differential Equations journal January 2018
Equation of state of warm dense deuterium and its isotopes from density-functional theory molecular dynamics journal April 2016