DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Unifying simulation and inference with normalizing flows

Journal Article · · Physical Review. D.

There have been many applications of deep neural networks to detector calibrations and a growing number of studies that propose deep generative models as automated fast detector simulators. We show that these two tasks can be unified by using maximum likelihood estimation (MLE) from conditional generative models for energy regression. Unlike direct regression techniques, the MLE approach is prior independent and non-Gaussian resolutions can be determined from the shape of the likelihood near the maximum. Using an ATLAS-like calorimeter simulation, we demonstrate this concept in the context of calorimeter energy calibration. Published by the American Physical Society 2025

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
US Department of Energy; USDOE; USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
2554055
Journal Information:
Physical Review. D., Journal Name: Physical Review. D. Journal Issue: 7 Vol. 111; ISSN PRVDAQ; ISSN 2470-0010
Publisher:
American Physical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (80)

Multivariate Density Estimation book August 1992
A Family of Nonparametric Density Estimation Algorithms journal September 2012
Observation of a new boson with mass near 125 GeV in pp collisions at $ \sqrt{s}=7 $ and 8 TeV journal June 2013
Learning the language of QCD jets with transformers journal June 2023
A Deep Neural Network for Simultaneous Estimation of b Jet Energy and Resolution journal October 2020
A multidimensional unfolding method based on Bayes' theorem journal August 1995
SVD approach to data unfolding
  • Höcker, Andreas; Kartvelishvili, Vakhtang
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 372, Issue 3 https://doi.org/10.1016/0168-9002(95)01478-0
journal April 1996
Geant4—a simulation toolkit
  • Agostinelli, S.; Allison, J.; Amako, K.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 506, Issue 3 https://doi.org/10.1016/S0168-9002(03)01368-8
journal July 2003
Recent developments in Geant4
  • Allison, J.; Amako, K.; Apostolakis, J.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 835 https://doi.org/10.1016/j.nima.2016.06.125
journal November 2016
Mathematical properties of numerical inversion for jet calibrations
  • Cukierman, Aviv; Nachman, Benjamin
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 858 https://doi.org/10.1016/j.nima.2017.03.038
journal June 2017
Electromagnetic showers beyond shower shapes
  • de Oliveira, Luke; Nachman, Benjamin; Paganini, Michela
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 951 https://doi.org/10.1016/j.nima.2019.162879
journal January 2020
Reconstructing the kinematics of deep inelastic scattering with deep learning
  • Arratia, Miguel; Britzger, Daniel; Long, Owen
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 1025 https://doi.org/10.1016/j.nima.2021.166164
journal February 2022
Measurement of the radius dependence of charged-particle jet suppression in Pb–Pb collisions at sNN=5.02TeV journal February 2024
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Learning to simulate high energy particle collisions from unlabeled data journal May 2022
The frontier of simulation-based inference journal May 2020
Probable networks and plausible predictions — a review of practical Bayesian methods for supervised neural networks journal January 1995
Parametrizing the detector response with neural networks journal January 2020
On the use of neural networks for energy reconstruction in high-granularity calorimeters journal December 2021
L2LFlows: generating high-fidelity 3D calorimeter images journal October 2023
Generative machine learning for detector response modeling with a conditional normalizing flow journal February 2024
The optimal use of segmentation for sampling calorimeters journal June 2024
TUnfold, an algorithm for correcting migration effects in high energy physics journal October 2012
i- flow : High-dimensional integration and sampling with normalizing flows journal November 2020
Simultaneous energy and mass calibration of large-radius jets with the ATLAS detector using a deep neural network journal September 2024
Machine-learning-based jet momentum reconstruction in heavy-ion collisions journal June 2019
Anomaly detection with density estimation journal April 2020
Event generation with normalizing flows journal April 2020
Bias and priors in machine learning calibrations for high energy physics journal August 2022
Classifying anomalies through outer density estimation journal September 2022
Fast and accurate simulations of calorimeter showers with normalizing flows journal June 2023
Accelerating accurate simulations of calorimeter showers with normalizing flows and probability density distillation journal June 2023
Resonant anomaly detection without background sculpting journal June 2023
Fast and improved neutrino reconstruction in multineutrino final states with conditional normalizing flows journal January 2024
Inductive simulation of calorimeter showers with normalizing flows journal February 2024
Improving generative model-based unfolding with Schrödinger bridges journal April 2024
Calorimeter shower superresolution journal May 2024
Anomaly detection with flow-based fast calorimeter simulators journal August 2024
Calibrating two jets at once journal October 2024
CaloGAN: Simulating 3D high energy particle showers in multilayer electromagnetic calorimeters with generative adversarial networks journal January 2018
Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multilayer Calorimeters journal January 2018
OmniFold: A Method to Simultaneously Unfold All Observables journal May 2020
Learning Uncertainties the Frequentist Way: Calibration and Correlation in High Energy Physics journal August 2022
Calorimetry for particle physics journal October 2003
Geant4 developments and applications journal February 2006
Observation of the diphoton decay of the Higgs boson and measurement of its properties journal October 2014
Calorimetric Measurement of Multi-TeV Muons via Deep Regression journal January 2022
Optimising longitudinal and lateral calorimeter granularity for software compensation in hadronic showers using deep neural networks journal January 2022
Inference of cosmic-ray source properties by conditional invertible neural networks journal February 2022
End-to-end multi-particle reconstruction in high occupancy imaging calorimeters with graph neural networks journal August 2022
Deeply learning deep inelastic scattering kinematics journal November 2022
New techniques for jet calibration with the ATLAS detector journal August 2023
Comparison of unfolding methods using RooFitUnfold journal August 2020
Bootstrap Methods: Another Look at the Jackknife journal January 1979
ATLAS liquid-argon calorimeter: Technical Design Report null January 1997
Phase space sampling and inference from weighted events with autoregressive flows journal January 2021
Measuring QCD Splittings with Invertible Networks journal June 2021
Targeting multi-loop integrals with neural networks journal April 2022
Understanding Event-Generation Networks via Uncertainties journal July 2022
Event Generation and Density Estimation with Surjective Normalizing Flows journal September 2022
Ephemeral Learning - Augmenting Triggers with Online-Trained Normalizing Flows journal October 2022
Generative networks for precision enthusiasts journal April 2023
$\nu$-flows: Conditional neutrino regression journal June 2023
Two invertible networks for the matrix element method journal September 2023
MadNIS - Neural multi-channel importance sampling journal October 2023
High-dimensional and permutation invariant anomaly detection journal February 2024
CaloFlow for CaloChallenge dataset 1 journal May 2024
Returning CP-observables to the frames they belong journal July 2024
The MadNIS reloaded journal July 2024
Towards a data-driven model of hadronization using normalizing flows journal August 2024
CURTAINs flows for flows: Constructing unobserved regions with maximum likelihood estimation journal August 2024
The landscape of unfolding with machine learning journal February 2025
Exploring phase space with Neural Importance Sampling journal January 2020
How to GAN away detector effects journal January 2020
Invertible networks or partons to detector and back again journal January 2020
Per-object systematics using deep-learned calibration journal January 2020
An unfolding method based on conditional invertible neural networks (cINN) using iterative training journal February 2024
Kicking it off(-shell) with direct diffusion journal September 2024
Machine Learning based jet momentum reconstruction in Pb-Pb collisions measured with the ALICE detector conference October 2020
Electromagnetic + Hadronic Sampling Calorimeter Shower Images dataset January 2024