Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Tools for unbinned unfolding

Journal Article · · Journal of Instrumentation
 [1];  [2];  [1];  [1];  [3];  [4]
  1. Univ. of California, Riverside, CA (United States)
  2. Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC)
  3. Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States); University of California, Berkeley, CA (United States)
  4. Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States); University of California, Berkeley, CA (United States); Stanford Univ., CA (United States); SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Machine learning has enabled differential cross section measurements that are not discretized. Going beyond the traditional histogram-based paradigm, these unbinned unfolding methods are rapidly being integrated into experimental workflows. Here, in order to enable widespread adaptation and standardization, we develop methods, benchmarks, and software for unbinned unfolding. For methodology, we demonstrate the utility of boosted decision trees for unfolding with a relatively small number of high-level features. This complements state-of-the-art deep learning models capable of unfolding the full phase space. To benchmark unbinned unfolding methods, we develop an extension of existing dataset to include acceptance effects, a necessary challenge for real measurements. Additionally, we directly compare binned and unbinned methods using discretized inputs for the latter in order to control for the binning itself. Lastly, we have assembled two software packages for the OmniFold unbinned unfolding method that should serve as the starting point for any future analyses using this technique. One package is based on the widely-used RooUnfold framework and the other is a standalone package available through the Python Package Index (PyPI).
Research Organization:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
Grant/Contract Number:
AC02-76SF00515
OSTI ID:
2573713
Journal Information:
Journal of Instrumentation, Journal Name: Journal of Instrumentation Journal Issue: 05 Vol. 20; ISSN 1748-0221
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United States
Language:
English

References (39)

DELPHES 3: a modular framework for fast simulation of a generic collider experiment journal February 2014
Anomaly detection in the presence of irrelevant features journal February 2024
Identifying boosted objects with N-subjettiness journal March 2011
Soft drop journal May 2014
A multidimensional unfolding method based on Bayes' theorem journal August 1995
SVD approach to data unfolding
  • Höcker, Andreas; Kartvelishvili, Vakhtang
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 372, Issue 3 https://doi.org/10.1016/0168-9002(95)01478-0
journal April 1996
ROOT — An object oriented data analysis framework journal April 1997
An introduction to PYTHIA 8.2 journal June 2015
Unbinned deep learning jet substructure measurement in high Q2 ep collisions at HERA journal September 2023
Learning to simulate high energy particle collisions from unlabeled data journal May 2022
Generalized angularities measurements from STAR at √SNN = 200 GeV journal January 2024
An iterative technique for the rectification of observed distributions journal June 1974
The anti- k t jet clustering algorithm journal April 2008
Publishing unbinned differential cross section results journal January 2022
TUnfold, an algorithm for correcting migration effects in high energy physics journal October 2012
Machine learning-based event generator for electron-proton scattering journal November 2022
Multidifferential study of identified charged hadron distributions in Z -tagged jets in proton-proton collisions at s=13  TeV journal August 2023
Tree-based algorithms for weakly supervised anomaly detection journal February 2024
Improving generative model-based unfolding with Schrödinger bridges journal April 2024
Solving key challenges in collider physics with foundation models journal March 2025
OmniFold: A Method to Simultaneously Unfold All Observables journal May 2020
Measurement of Lepton-Jet Correlation in Deep-Inelastic Scattering with the H1 Detector Using Machine Learning for Unfolding journal March 2022
Simultaneous Unbinned Differential Cross-Section Measurement of Twenty-Four Z+jets Kinematic Observables with the ATLAS Detector journal December 2024
Some inequalities for information divergence and related measures of discrimination journal July 2000
Maximum Likelihood Reconstruction for Emission Tomography journal October 1982
FastJet user manual: (for version 3.0.2) journal March 2012
Comparison of unfolding methods using RooFitUnfold journal August 2020
Bayesian-Based Iterative Method of Image Restoration* journal January 1972
Machine learning and LHC event generation journal April 2023
$\nu$-flows: Conditional neutrino regression journal June 2023
Returning CP-observables to the frames they belong journal July 2024
The landscape of unfolding with machine learning journal February 2025
Full event particle-level unfolding with variable-length latent variational diffusion journal April 2025
How to GAN away detector effects journal January 2020
Invertible networks or partons to detector and back again journal January 2020
Kicking it off(-shell) with direct diffusion journal September 2024
An unfolding method based on conditional invertible neural networks (cINN) using iterative training journal February 2024
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems preprint January 2016
Pythia/Herwig + Delphes Jet Datasets for OmniFold Unfolding dataset January 2019

Similar Records

OmniFold: A Method to Simultaneously Unfold All Observables
Journal Article · Wed May 06 20:00:00 EDT 2020 · Physical Review Letters · OSTI ID:1617705