Distance preserving machine learning for uncertainty aware accelerator capacitance predictions
Abstract Accurate uncertainty estimations are essential for producing reliable machine learning models, especially in safety-critical applications such as accelerator systems. Gaussian process models are generally regarded as the gold standard for this task; however, they can struggle with large, high-dimensional datasets. Combining deep neural networks with Gaussian process approximation techniques has shown promising results, but dimensionality reduction through standard deep neural network layers is not guaranteed to maintain the distance information necessary for Gaussian process models. We build on previous work by comparing the use of the singular value decomposition against a spectral-normalized dense layer as a feature extractor for a deep neural Gaussian process approximation model and apply it to a capacitance prediction problem for the High Voltage Converter Modulators in the Oak Ridge Spallation Neutron Source. Our model shows improved distance preservation and predicts in-distribution capacitance values with less than 1% error.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States); Thomas Jefferson National Accelerator Facility (TJNAF), Newport News, VA (United States)
- Sponsoring Organization:
- USDOE; USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)
- Grant/Contract Number:
- AC05-00OR22725; AC05-06OR23177; SC0009915
- OSTI ID:
- 2459383
- Report Number(s):
- DOE/OR/23177--7115; JLAB-CST--23-3913; arXiv:2307.02367
- Journal Information:
- Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 4 Vol. 5; ISSN 2632-2153
- Publisher:
- IOP PublishingCopyright Statement
- Country of Publication:
- United Kingdom
- Language:
- English
Similar Records
DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network
Robust errant beam prognostics with conditional modeling for particle accelerators