Moment extraction using an unfolding protocol without binning

Desai, Krish; Nachman, Benjamin; Thaler, Jesse

doi:10.1103/physrevd.110.116013

Title: Moment extraction using an unfolding protocol without binning

Journal Article · 13 December 2024 · Physical Review. D.

DOI: https://doi.org/10.1103/physrevd.110.116013 · OSTI ID:2481387

^[1];

^[2];

^[3]

University of California, Berkeley, CA (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States); University of California, Berkeley, CA (United States)
Massachusetts Institute of Technology (MIT), Cambridge, MA (United States); NSF AI Institute for Artificial Intelligence and Fundamental Interactions, Cambridge, MA (United States)

Deconvolving (“unfolding”) detector distortions is a critical step in the comparison of cross-section measurements with theoretical predictions in particle and nuclear physics. However, most existing approaches require histogram binning while many theoretical predictions are at the level of statistical moments. We develop a new approach to directly unfold distribution moments as a function of another observable without having to first discretize the data. Our moment unfolding technique uses machine learning and is inspired by Boltzmann weight factors and generative adversarial networks (GANs). We demonstrate the performance of this approach using jet substructure measurements in collider physics. With this illustrative example, we find that our moment unfolding protocol is more precise than bin-based approaches and is as or more precise than completely unbinned methods.

View Journal Article

Cite

Export

Save

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Sponsoring Organization:: National Science Foundation (NSF); Simons Foundation; USDOE Office of Science (SC), High Energy Physics (HEP)

Grant/Contract Number:: AC02-05CH11231; SC0012567

OSTI ID:: 2481387

Journal Information:: Physical Review. D., Journal Name: Physical Review. D. Journal Issue: 11 Vol. 110; ISSN 2470-0010

Publisher:: American Physical Society (APS)Copyright Statement

Country of Publication:: United States

Language:: English

References (70)

Global jet properties at 14?44 GeV center of mass energy ine + e ? annihilation Braunschweig, W.; Gerhards, R.; Kirschfink, F. J. Zeitschrift f�r Physik C Particles and Fields, Vol. 47, Issue 2 https://doi.org/10.1007/BF01552339	journal	June 1990
DELPHES 3: a modular framework for fast simulation of a generic collider experiment de Favereau, J.; Delaere, C.; Demin, P. Journal of High Energy Physics, Vol. 2014, Issue 2 https://doi.org/10.1007/JHEP02(2014)057	journal	February 2014
Soft drop Larkoski, Andrew J.; Marzani, Simone; Soyez, Gregory Journal of High Energy Physics, Vol. 2014, Issue 5 https://doi.org/10.1007/JHEP05(2014)146	journal	May 2014
Measurement of quark- and gluon-like jet fractions using jet charge in PbPb and pp collisions at 5.02 TeV Sirunyan, A. M.; Tumasyan, A.; Adam, W. Journal of High Energy Physics, Vol. 2020, Issue 7 https://doi.org/10.1007/JHEP07(2020)115	journal	July 2020
Towards an understanding of jet substructure Dasgupta, Mrinal; Fregoso, Alessandro; Marzani, Simone Journal of High Energy Physics, Vol. 2013, Issue 9 https://doi.org/10.1007/JHEP09(2013)029	journal	September 2013
Fitting a deep generative hadronization model Chan, Jay; Ju, Xiangyang; Kania, Adam Journal of High Energy Physics, Vol. 2023, Issue 9 https://doi.org/10.1007/JHEP09(2023)084	journal	September 2023
Measurements of jet charge with dijet events in pp collisions at s = 8 $$ \sqrt{s}=8 $$ TeV Sirunyan, A. M.; Tumasyan, A.; Adam, W. Journal of High Energy Physics, Vol. 2017, Issue 10 https://doi.org/10.1007/JHEP10(2017)131	journal	October 2017
The Generalized Cross Entropy Method, with Applications to Probability Density Estimation Botev, Zdravko I.; Kroese, Dirk P. Methodology and Computing in Applied Probability, Vol. 13, Issue 1 https://doi.org/10.1007/S11009-009-9133-7	journal	May 2009
QCD studies with ${\rm e^+e^-}$ annihilation data at 161 GeV Ackerstaff et al., K. Zeitschrift f�r Physik C Particles and Fields, Vol. 75, Issue 2 https://doi.org/10.1007/s002880050462	journal	June 1997
A study of event shapes and determinations of $\alpha_s$ using data of ${\rm e^+e-}$ annihilations at $\sqrt{s} =22$ to 44 GeV Movilla Fernández, P. A.; Biebel, O.; Bethke, S. The European Physical Journal C, Vol. 1, Issue 3 https://doi.org/10.1007/s100520050096	journal	February 1998
Unfolding by weighting Monte Carlo events Lindemann, L.; Zech, G. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 354, Issue 2-3 https://doi.org/10.1016/0168-9002(94)01067-6	journal	January 1995
A multidimensional unfolding method based on Bayes' theorem D'Agostini, G. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 362, Issue 2-3 https://doi.org/10.1016/0168-9002(95)00274-X	journal	August 1995
SVD approach to data unfolding Höcker, Andreas; Kartvelishvili, Vakhtang Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 372, Issue 3 https://doi.org/10.1016/0168-9002(95)01478-0	journal	April 1996
Asymptotic freedom in parton language Altarelli, G.; Parisi, G. Nuclear Physics B, Vol. 126, Issue 2 https://doi.org/10.1016/0550-3213(77)90384-4	journal	August 1977
QCD studies in e+e− annihilation from 30 GeV to 189 GeV Acciarri, M.; Achard, P.; Adriani, O. Physics Letters B, Vol. 489, Issue 1-2 https://doi.org/10.1016/S0370-2693(00)00891-1	journal	September 2000
Energy dependence of event shapes and of αs at LEP 2 Abreu, P.; Adam, W.; Adye, T. Physics Letters B, Vol. 456, Issue 2-4 https://doi.org/10.1016/S0370-2693(99)00472-4	journal	June 1999
A brief introduction to PYTHIA 8.1 Sjöstrand, Torbjörn; Mrenna, Stephen; Skands, Peter Computer Physics Communications, Vol. 178, Issue 11 https://doi.org/10.1016/j.cpc.2008.01.036	journal	June 2008
An introduction to PYTHIA 8.2 Sjöstrand, Torbjörn; Ask, Stefan; Christiansen, Jesper R. Computer Physics Communications, Vol. 191 https://doi.org/10.1016/j.cpc.2015.01.024	journal	June 2015
Dispelling the N3 myth for the kt jet-finder Cacciari, Matteo; Salam, Gavin P. Physics Letters B, Vol. 641, Issue 1 https://doi.org/10.1016/j.physletb.2006.08.037	journal	September 2006
Unbinned deep learning jet substructure measurement in high Q2 ep collisions at HERA Andreev, V.; Arratia, M.; Baghdasaryan, A. Physics Letters B, Vol. 844 https://doi.org/10.1016/j.physletb.2023.138101	journal	September 2023
Studies of hadronic event structure in e+e- annihilation from 30 to 209GeV with the L3 detector Achard, P.; Adriani, O.; Aguilar-Benitez, M. Physics Reports, Vol. 399, Issue 2-3 https://doi.org/10.1016/j.physrep.2004.07.002	journal	September 2004
Jet substructure at the Large Hadron Collider: A review of recent advances in theory and machine learning Larkoski, Andrew J.; Moult, Ian; Nachman, Benjamin Physics Reports https://doi.org/10.1016/j.physrep.2019.11.001	journal	November 2019
Array programming with NumPy Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J. Nature, Vol. 585, Issue 7825 https://doi.org/10.1038/s41586-020-2649-2	journal	September 2020
Learning to simulate high energy particle collisions from unlabeled data Howard, Jessica N.; Mandt, Stephan; Whiteson, Daniel Scientific Reports, Vol. 12, Issue 1 https://doi.org/10.1038/s41598-022-10966-7	journal	May 2022
An iterative technique for the rectification of observed distributions Lucy, L. B. The Astronomical Journal, Vol. 79 https://doi.org/10.1086/111605	journal	June 1974
PYTHIA 6.4 physics and manual Sjöstrand, Torbjörn; Mrenna, Stephen; Skands, Peter Journal of High Energy Physics, Vol. 2006, Issue 05 https://doi.org/10.1088/1126-6708/2006/05/026	journal	May 2006
The anti- k _t jet clustering algorithm Cacciari, Matteo; Salam, Gavin P.; Soyez, Gregory Journal of High Energy Physics, Vol. 2008, Issue 04 https://doi.org/10.1088/1126-6708/2008/04/063	journal	April 2008
Adversarial Neural Network-based data-simulation corrections for jet-tagging at CMS Erdmann, Martin; Fischer, Benjamin; Noll, Dennis Journal of Physics: Conference Series, Vol. 1525, Issue 1 https://doi.org/10.1088/1742-6596/1525/1/012094	journal	April 2020
Particle-flow reconstruction and global event description with the CMS detector Sirunyan, A. M.; Tumasyan, A.; Adam, W. Journal of Instrumentation, Vol. 12, Issue 10 https://doi.org/10.1088/1748-0221/12/10/P10003	journal	October 2017
Publishing unbinned differential cross section results Arratia, Miguel; Butter, Anja; Campanelli, Mario Journal of Instrumentation, Vol. 17, Issue 01 https://doi.org/10.1088/1748-0221/17/01/P01024	journal	January 2022
Optimizing observables with machine learning for better unfolding Arratia, Miguel; Britzger, Daniel; Long, Owen Journal of Instrumentation, Vol. 17, Issue 07 https://doi.org/10.1088/1748-0221/17/07/P07009	journal	July 2022
TUnfold, an algorithm for correcting migration effects in high energy physics Schmitt, S. Journal of Instrumentation, Vol. 7, Issue 10 https://doi.org/10.1088/1748-0221/7/10/T10003	journal	October 2012
Robust and provably monotonic networks Kitouni, Ouail; Nolte, Niklas; Williams, Mike Machine Learning: Science and Technology, Vol. 4, Issue 3 https://doi.org/10.1088/2632-2153/aced80	journal	August 2023
Jet charge modification in finite QCD matter Li, Hai Tao; Vitev, Ivan Physical Review D, Vol. 101, Issue 7 https://doi.org/10.1103/PhysRevD.101.076020	journal	April 2020
Dynamic jet charge Kang, Zhong-Bo; Liu, Xiaohui; Mantry, Sonny Physical Review D, Vol. 103, Issue 7 https://doi.org/10.1103/PhysRevD.103.074028	journal	April 2021
Learning from many collider events at once Nachman, Benjamin; Thaler, Jesse Physical Review D, Vol. 103, Issue 11 https://doi.org/10.1103/PhysRevD.103.116013	journal	June 2021
Disentangling quarks and gluons in CMS open data Komiske, Patrick T.; Kryhin, Serhii; Thaler, Jesse Physical Review D, Vol. 106, Issue 9 https://doi.org/10.1103/PhysRevD.106.094021	journal	November 2022
Unbinned profiled unfolding Chan, Jay; Nachman, Benjamin Physical Review D, Vol. 108, Issue 1 https://doi.org/10.1103/PhysRevD.108.016002	journal	July 2023
Toward a generative modeling analysis of CLAS exclusive 2π photoproduction Alghamdi, T.; Alanazi, Y.; Battaglieri, M. Physical Review D, Vol. 108, Issue 9 https://doi.org/10.1103/PhysRevD.108.094030	journal	November 2023
Multidifferential study of identified charged hadron distributions in Z -tagged jets in proton-proton collisions at s=13 TeV Aaij, R.; Abdelmotteleb, A. S. W.; Abellan Beteta, C. Physical Review D, Vol. 108, Issue 3 https://doi.org/10.1103/PhysRevD.108.L031103	journal	August 2023
Improving generative model-based unfolding with Schrödinger bridges Diefenbacher, Sascha; Liu, Guan-Horng; Mikuni, Vinicius Physical Review D, Vol. 109, Issue 7 https://doi.org/10.1103/PhysRevD.109.076011	journal	April 2024
Infrared-safe energy weighting does not guarantee small nonperturbative effects Bright-Thonney, Samuel; Nachman, Benjamin; Thaler, Jesse Physical Review D, Vol. 110, Issue 1 https://doi.org/10.1103/PhysRevD.110.014029	journal	July 2024
Multihadron-event properties in e + e − annihilation at s = 52 − 57 GeV Li, Y. K.; Li, J.; Cheng, C. P. Physical Review D, Vol. 41, Issue 9 https://doi.org/10.1103/PhysRevD.41.2675	journal	May 1990
Precision thrust cumulant moments at N 3 LL Abbate, Riccardo; Fickinger, Michael; Hoang, André H. Physical Review D, Vol. 86, Issue 9 https://doi.org/10.1103/PhysRevD.86.094002	journal	November 2012
Calculating the charge of a jet Waalewijn, Wouter J. Physical Review D, Vol. 86, Issue 9 https://doi.org/10.1103/PhysRevD.86.094030	journal	November 2012
Sudakov safety in perturbative QCD Larkoski, Andrew J.; Marzani, Simone; Thaler, Jesse Physical Review D, Vol. 91, Issue 11 https://doi.org/10.1103/PhysRevD.91.111501	journal	June 2015
Measurement of jet charge in dijet events from s = 8 TeV p p collisions with the ATLAS detector Aad, G.; Abbott, B.; Abdallah, J. Physical Review D, Vol. 93, Issue 5 https://doi.org/10.1103/PhysRevD.93.052003	journal	March 2016
Learning new physics from a machine D’Agnolo, Raffaele Tito; Wulzer, Andrea Physical Review D, Vol. 99, Issue 1 https://doi.org/10.1103/PhysRevD.99.015014	journal	January 2019
Jet Charge at the LHC Krohn, David; Schwartz, Matthew D.; Lin, Tongyan Physical Review Letters, Vol. 110, Issue 21 https://doi.org/10.1103/PhysRevLett.110.212001	journal	May 2013
OmniFold: A Method to Simultaneously Unfold All Observables Andreassen, Anders; Komiske, Patrick T.; Metodiev, Eric M. Physical Review Letters, Vol. 124, Issue 18 https://doi.org/10.1103/PhysRevLett.124.182001	journal	May 2020
Jet Charge: A Flavor Prism for Spin Asymmetries at the Electron-Ion Collider Kang, Zhong-Bo; Liu, Xiaohui; Mantry, Sonny Physical Review Letters, Vol. 125, Issue 24 https://doi.org/10.1103/PhysRevLett.125.242003	journal	December 2020
Measurement of the Groomed Jet Radius and Momentum Splitting Fraction in p p and Pb-Pb Collisions at s N N = 5.02 TeV Acharya, S.; Adamová, D.; Adler, A. Physical Review Letters, Vol. 128, Issue 10 https://doi.org/10.1103/PhysRevLett.128.102001	journal	March 2022
Measurement of Lepton-Jet Correlation in Deep-Inelastic Scattering with the H1 Detector Using Machine Learning for Unfolding Andreev, V.; Arratia, M.; Baghdasaryan, A. Physical Review Letters, Vol. 128, Issue 13 https://doi.org/10.1103/PhysRevLett.128.132002	journal	March 2022
Jet substructure at the Large Hadron Collider Kogler, Roman; Nachman, Benjamin; Schmidt, Alexander Reviews of Modern Physics, Vol. 91, Issue 4 https://doi.org/10.1103/RevModPhys.91.045003	journal	December 2019
Matplotlib: A 2D Graphics Environment Hunter, John D. Computing in Science & Engineering, Vol. 9, Issue 3 https://doi.org/10.1109/MCSE.2007.55	journal	January 2007
Herwig++ physics and manual Bähr, Manuel; Gieseke, Stefan; Gigg, Martyn A. The European Physical Journal C, Vol. 58, Issue 4 https://doi.org/10.1140/epjc/s10052-008-0798-9	journal	November 2008
Study of moments of event shapes and a determination of α S using e+e− annihilation data from JADE Pahl, C.; Bethke, S.; Kluth, S. The European Physical Journal C, Vol. 60, Issue 2 https://doi.org/10.1140/epjc/s10052-009-0930-5	journal	February 2009
Study of moments of event shapes and a determination of α S using e+e− annihilation data from JADE Pahl, C.; Bethke, S.; Kluth, S. The European Physical Journal C, Vol. 62, Issue 2 https://doi.org/10.1140/epjc/s10052-009-1032-0	journal	May 2009
FastJet user manual: (for version 3.0.2) Cacciari, Matteo; Salam, Gavin P.; Soyez, Gregory The European Physical Journal C, Vol. 72, Issue 3 https://doi.org/10.1140/epjc/s10052-012-1896-2	journal	March 2012
Herwig 7.0/Herwig++ 3.0 release note Bellm, Johannes; Gieseke, Stefan; Grellscheid, David The European Physical Journal C, Vol. 76, Issue 4 https://doi.org/10.1140/epjc/s10052-016-4018-8	journal	April 2016
Learning multivariate new physics D’Agnolo, Raffaele Tito; Grosso, Gaia; Pierini, Maurizio The European Physical Journal C, Vol. 81, Issue 1 https://doi.org/10.1140/epjc/s10052-021-08853-y	journal	January 2021
A study of the energy evolution of event shape distributions and their means with the DELPHI detector at LEP The European Physical Journal C, Vol. 29, Issue 3, p. 285-312 https://doi.org/10.1140/epjc/s2003-01198-0	journal	July 2003
Studies of QCD at ${\rm e}^ + {\rm e}^-$ centre-of-mass energies between 91 and 209 GeV The European Physical Journal C, Vol. 35, Issue 4, p. 457-486 https://doi.org/10.1140/epjc/s2004-01891-4	journal	July 2004
Comparison of unfolding methods using RooFitUnfold Brenner, Lydia; Balasubramanian, Rahul; Burgard, Carsten International Journal of Modern Physics A, Vol. 35, Issue 24 https://doi.org/10.1142/S0217751X20501456	journal	August 2020
Bayesian-Based Iterative Method of Image Restoration* Richardson, William Hadley Journal of the Optical Society of America, Vol. 62, Issue 1 https://doi.org/10.1364/JOSA.62.000055	journal	January 1972
Towards a data-driven model of hadronization using normalizing flows Bierlich, Christian; Ilten, Philip; Menzo, Tony SciPost Physics, Vol. 17, Issue 2 https://doi.org/10.21468/SciPostPhys.17.2.045	journal	August 2024
How to GAN away detector effects Bellagente, Marco; Butter, Anja; Kasieczka, Gregor SciPost Physics, Vol. 8, Issue 4 https://doi.org/10.21468/SciPostPhys.8.4.070	journal	January 2020
Invertible networks or partons to detector and back again Bellagente, Marco; Butter, Anja; Kasieczka, Gregor SciPost Physics, Vol. 9, Issue 5 https://doi.org/10.21468/SciPostPhys.9.5.074	journal	January 2020
An unfolding method based on conditional invertible neural networks (cINN) using iterative training Backes, Mathias; Butter, Anja; Dunford, Monica SciPost Physics Core, Vol. 7, Issue 1 https://doi.org/10.21468/SciPostPhysCore.7.1.007	journal	February 2024
Translation of Ludwig Boltzmann’s Paper “On the Relationship between the Second Fundamental Theorem of the Mechanical Theory of Heat and Probability Calculations Regarding the Conditions for Thermal Equilibrium” Sitzungberichte der Kaiserlichen Akademie der Wissenschaften. Mathematisch-Naturwissen Classe. Abt. II, LXXVI 1877, pp 373-435 (Wien. Ber. 1877, 76:373-435). Reprinted in Wiss. Abhandlungen, Vol. II, reprint 42, p. 164-223, Barth, Leipzig, 1909 Sharp, Kim; Matschinsky, Franz Entropy, Vol. 17, Issue 4 https://doi.org/10.3390/e17041971	journal	April 2015

Similar Records

OmniFold: A Method to Simultaneously Unfold All Observables

Journal Article · 2020 · Physical Review Letters · OSTI ID:1617705

Andreassen, Anders; Komiske, Patrick T.; Metodiev, Eric M.; +2 more

Tools for unbinned unfolding

Journal Article · 2025 · Journal of Instrumentation · OSTI ID:2573713

Milton, Ryan; Mikuni, Vinicius; Lee, Trevin; +3 more

Generative unfolding with distribution mapping

Journal Article · 2025 · SciPost Physics · OSTI ID:2572503

Butter, Anja; Diefenbacher, Sascha; Huetsch, Nathan; +4 more

Related Subjects

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Title: Moment extraction using an unfolding protocol without binning

Citation Formats

References (70)

Similar Records

Related Subjects