Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Amortized simulation-based frequentist inference for tractable and intractable likelihoods

Journal Article · · Machine Learning: Science and Technology
Abstract

High-fidelity simulators that connect theoretical models with observations are indispensable tools in many sciences. If the likelihood is known, inference can proceed using standard techniques. However, when the likelihood is intractable or unknown, a simulator makes it possible to infer the parameters of a theoretical model directly from real and simulated observations when coupled with machine learning. We introduce an extension of the recently proposed likelihood-free frequentist inference ( LF2I ) approach that makes it possible to construct confidence sets with the p -value function and to use the same function to check the coverage explicitly at any given parameter point. Like LF2I , this extension yields provably valid confidence sets in parameter inference problems for which a high-fidelity simulator is available. The utility of our algorithm is illustrated by applying it to three pedagogically interesting examples: the first is from cosmology, the second from high-energy physics and astronomy, both with tractable likelihoods, while the third, with an intractable likelihood, is from epidemiology 3 3

Code to reproduce all of our results is available on https://github.com/AliAlkadhim/ALFFI .

.

Research Organization:
Florida State Univ., Tallahassee, FL (United States)
Sponsoring Organization:
USDOE; USDOE Office of Science (SC)
Grant/Contract Number:
SC0010102
OSTI ID:
2283798
Alternate ID(s):
OSTI ID: 2282388
OSTI ID: 2578868
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 1 Vol. 5; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (20)

Experimental search for neutron-antineutron transitions with free neutrons journal June 1985
Neutron-antineutron oscillations: Theoretical status and experimental prospects journal February 2016
Searching for new phenomena with profile likelihood ratio tests journal April 2020
Simulation-based inference in particle physics journal March 2021
The frontier of simulation-based inference journal May 2020
Measurements of Ω and Λ from 42 High‐Redshift Supernovae journal June 1999
Analysis methods for results in gamma-ray astronomy journal September 1983
Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant journal September 1998
THE HUBBLE SPACE TELESCOPE CLUSTER SUPERNOVA SURVEY. V. IMPROVING THE DARK-ENERGY CONSTRAINTS ABOVE z > 1 AND BUILDING AN EARLY-TYPE-HOSTED SUPERNOVA SAMPLE journal January 2012
A Contribution to the Mathematical Theory of Epidemics journal August 1927
On the Problem of the Most Efficient Tests of Statistical Hypotheses
  • Neyman, J.; Pearson, E. S.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 231, Issue 694-706 https://doi.org/10.1098/rsta.1933.0009
journal January 1933
Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability journal August 1937
The cosmological constant and dark energy journal April 2003
Phantom Energy: Dark Energy with w < − 1 Causes a Cosmic Doomsday journal August 2003
The multilayer perceptron as an approximation to a Bayes optimal discriminant function journal January 1990
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification conference December 2015
A theorem for physicists in the theory of random variables journal June 1983
Asymptotic formulae for likelihood-based tests of new physics journal February 2011
Neural Network Classifiers Estimate Bayesian a posteriori Probabilities journal December 1991
The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses journal March 1938

Similar Records

MONKES: a fast neoclassical code for the evaluation of monoenergetic transport coefficients in stellarator plasmas
Journal Article · Sun Jun 02 20:00:00 EDT 2024 · Nuclear Fusion · OSTI ID:2369835