DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Role of the likelihood for elastic scattering uncertainty quantification

Journal Article · · Physical Review. C

In the last decade, uncertainty quantification (UQ) for optical model potentials (OMPs) has become a focal point for nuclear reaction theory, and several competing approaches for OMP UQ have recently been developed. Here, we clarify recent efforts to compare frequentist and Bayesian approaches in the context of OMP UQ [G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019)]. We replicate a portion of that OMP UQ study but use independent statistical tools. Specifically, we compare two methods for OMP parameter inference from elastic scattering data: the Levenberg-Marquardt algorithm for χ2 minimization on one hand and Markov chain Monte Carlo (MCMC) sampling on the other. Separately, we assess the common practice of using a renormalized likelihood (χ2/N), N being the number of data points, instead of the canonical weighted-least-squares likelihood (χ2), as a way of accounting for unknown data correlations. Here, we show that for a generic linear model and for a five-parameter OMP analysis, frequentist and uniform-prior Bayesian approaches recover the same optimum and uncertainty estimates—not systematically larger uncertainties for the Bayesian approach, as was concluded in G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019). Further, we show that if an additional, near-degenerate parameter is introduced into the same OMP analysis such that the parameter posterior becomes non-Gaussian, then covariance-based estimates of uncertainty become unreliable. Finally, we show that regardless of optimization approach, if χ2/N is used for the likelihood, the resulting parametric uncertainties increase by $$\sqrt{N}$$, and that this is responsible for the conclusions drawn in the revisited study. Based on our replication results, we find that a fortuitous cancellation of unreported errors and the renormalization factor can lead to improvement in empirical coverages, as was the case in the original comparative study. We emphasize that developing and applying a realistic likelihood function is an essential task in a UQ analysis, and that several recent UQ studies that employed a renormalized likelihood (i.e., including a 1/N factor) may have yielded unrealistically large uncertainties for elastic-scattering observables. If the parameter posterior deviates from multivariate-normal, a sampling-based approach like MCMC has a clear advantage over methods that assume the Laplace approximation holds. We note that empirical coverage can serve as an important internal check for the analyst whose model or data may have additional, unaccounted-for uncertainties.

Research Organization:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC)
Grant/Contract Number:
89233218CNA000001; AC52-07NA27344; SC0021422
OSTI ID:
2483518
Report Number(s):
LA-UR--24-21479; LLNL--JRNL-860637
Journal Information:
Physical Review. C, Journal Name: Physical Review. C Journal Issue: 6 Vol. 110; ISSN 2469-9985
Publisher:
American Physical Society (APS)Copyright Statement
Country of Publication:
United States
Language:
English

References (34)

Neutron scattering from 90,91,92,94Zr journal October 1990
Consistent Procedure for Nuclear Data Evaluation Based on Modeling journal December 2008
Covariances from Light-Element R-Matrix Analyses journal December 2008
Data Covariances from R-Matrix Analyses of Light Nuclei journal January 2015
Evaluation of Neutron Reactions on Iron Isotopes for CIELO and ENDF/B-VIII.0 journal February 2018
Unrecognized Sources of Uncertainties (USU) in Experimental Nuclear Data journal January 2020
Applying a Template of Expected Uncertainties to Updating 239Pu(n,f) Cross-section Covariances in the Neutron Data Standards Database journal January 2020
Ab initio informed evaluation of the radiative capture of protons on 7Be journal October 2023
Nuclear Reactions for Astrophysics: Principles, Calculation and Applications of Low-Energy Reactions book January 2009
Templates of expected measurement uncertainties journal January 2023
Bayes in the sky: Bayesian inference and model selection in cosmology journal March 2008
emcee : The MCMC Hammer
  • Foreman-Mackey, Daniel; Hogg, David W.; Lang, Dustin
  • Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 925 https://doi.org/10.1086/670067
journal March 2013
Systematic uncertainties in direct reaction theories journal February 2015
Recent advances in the quantification of uncertainties in reaction theory journal December 2020
Get on the BAND Wagon: a Bayesian framework for quantifying model uncertainties in nuclear dynamics journal May 2021
A method for the solution of certain non-linear problems in least squares journal January 1944
Nucleon-Nucleus Optical-Model Parameters, A > 40 , E < 50 MeV journal June 1969
The Calculation of Errors by the Method of Least Squares journal April 1932
Exploring experimental conditions to reduce uncertainties in the optical potential journal December 2019
Statistical tools for a better optical model journal December 2021
Prediction for ( p,n ) charge-exchange reactions with uncertainty quantification journal May 2022
Uncertainty quantification in breakup reactions journal August 2022
Uncertainty-quantified phenomenological optical potentials for single-nucleon scattering journal January 2023
Quantifying uncertainties due to optical potentials in one-neutron knockout reactions journal July 2023
Complete quantification of parametric uncertainties in (d,p) transfer reactions journal August 2023
Uncertainty quantification for optical model parameters journal February 2017
Constraining transfer cross sections using Bayes' theorem journal June 2018
Uncertainty quantification due to optical potentials in models for ( d , p ) reactions journal October 2018
Direct Comparison between Bayesian and Frequentist Uncertainty Quantification for Nuclear Reactions journal June 2019
New Perspectives on Spectroscopic Factor Quenching from Reactions journal November 2023
An Algorithm for Least-Squares Estimation of Nonlinear Parameters journal June 1963
Bayesian Monte Carlo method for nuclear data evaluation journal December 2015
Bayesian Data Analysis book November 2013
corner.py: Scatterplot matrices in Python journal June 2016