DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Anomaly detection in collider physics via factorized observables

Journal Article · · Physical Review. D.

To maximize the discovery potential of high-energy colliders, experimental searches should be sensitive to unforeseen new physics scenarios. This goal has motivated the use of machine learning for unsupervised anomaly detection. In this paper, we introduce a new anomaly detection strategy called : factorized observables for regressing conditional expectations. Our approach is based on the inductive bias of factorization, which is the idea that the physics governing different energy scales can be treated as approximately independent. Assuming factorization holds separately for signal and background processes, the appearance of nontrivial correlations between low- and high-energy observables is a robust indicator of new physics. Under the most restrictive form of factorization, a machine-learned model trained to identify such correlations will in fact converge to the optimal new physics classifier. We test on a benchmark anomaly detection task for the Large Hadron Collider involving collimated sprays of particles called jets. By teasing out correlations between the kinematics and substructure of jets, our method can reliably extract percent-level signal fractions. This strategy for uncovering new physics adds to the growing toolbox of anomaly detection methods for collider physics with a complementary set of assumptions. Published by the American Physical Society 2024

Sponsoring Organization:
USDOE Office of Science (SC), Nuclear Physics (NP); USDOE Office of Science (SC), High Energy Physics (HEP)
Grant/Contract Number:
SC0011090; SC0012567; SC0019128
OSTI ID:
2440309
Journal Information:
Physical Review. D., Journal Name: Physical Review. D. Journal Issue: 5 Vol. 110; ISSN PRVDAQ; ISSN 2470-0010
Publisher:
American Physical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (141)

Looking Inside Jets: An Introduction to Jet Substructure and Boosted-object Phenomenology book January 2019
Tag N’ Train: a technique to train improved classifiers on unlabeled data journal January 2021
RanBox: anomaly detection in the copula space journal January 2023
Maximizing boosted top identification by minimizing N-subjettiness journal February 2012
DELPHES 3: a modular framework for fast simulation of a generic collider experiment journal February 2014
(Machine) learning to do more with less journal February 2018
Does SUSY have friends? A new approach for LHC event analysis journal February 2021
Autoencoders for semivisible jet detection journal February 2022
Quantum anomaly detection for collider physics journal February 2023
Anomaly detection in the presence of irrelevant features journal February 2024
Identifying boosted objects with N-subjettiness journal March 2011
Mass Unspecific Supervised Tagging (MUST) for boosted jets journal March 2021
Challenges for unsupervised anomaly detection in particle physics journal March 2022
Mixture-of-Theories training: can we find new physics and anomalies better by mixing physical theories? journal March 2023
Energy flow polynomials: a complete linear basis for jet substructure journal April 2018
Erratum to: Mass Unspecific Supervised Tagging (MUST) for boosted jets journal April 2021
Topological obstructions to autoencoding journal April 2021
Jet substructure templates: data-driven QCD backgrounds for fat jet searches journal May 2014
Soft drop journal May 2014
Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure journal May 2016
Weakly supervised classification in high energy physics journal May 2017
Convolved substructure: analytically decorrelating jet substructure observables journal May 2018
Variational autoencoders for new physics mining at the Large Hadron Collider journal May 2019
Machine learning templates for QCD factorization in the search for physics beyond the standard model journal May 2019
Quasi anomalous knowledge: searching for new physics with embedded knowledge journal June 2021
Autoencoders for unsupervised anomaly detection in high energy physics journal June 2021
Factorization for groomed jet substructure beyond the next-to-leading logarithm journal July 2016
The hidden geometry of particle collisions journal July 2020
Neural embedding: learning the embedding of the manifold of physics data journal July 2023
Anomaly detection with convolutional Graph Neural Networks journal August 2021
Unsupervised event classification with graphs on classical and photonic quantum computers journal August 2021
Boosting mono-jet searches with model-agnostic machine learning journal August 2022
Towards an understanding of jet substructure journal September 2013
Combining outlier analysis algorithms to identify new physics at the LHC journal September 2021
Classification without labels: learning from mixed samples in high energy physics journal October 2017
Adversarially-trained autoencoders for robust unsupervised new physics searches journal October 2019
Learning the latent structure of collider events journal October 2020
A generic anti-QCD jet tagger journal November 2017
An operational definition of quark and gluon jets journal November 2018
Power counting to better jet observables journal December 2014
New angles on energy correlation functions journal December 2016
Autoencoder-Based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter journal June 2024
Invariant operators in collinear effective theory journal September 2001
Soft-collinear effective theory and heavy-to-light currents beyond leading power journal November 2002
A brief introduction to PYTHIA 8.1 journal June 2008
An introduction to PYTHIA 8.2 journal June 2015
Narrow-width approximation accuracy journal June 2009
Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC journal September 2012
Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC journal September 2012
Measurement of the t t ‾ b b ‾ production cross section in the all-jet final state in pp collisions at s = 13  TeV journal April 2020
Null hypothesis test for anomaly detection journal May 2023
Jet substructure at the Large Hadron Collider: A review of recent advances in theory and machine learning journal November 2019
Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays journal April 2024
LHC physics dataset for unsupervised New Physics detection at 40 MHz journal March 2022
Autoencoders on field-programmable gate arrays for real-time, unsupervised new physics detection at 40 MHz at the Large Hadron Collider journal February 2022
The anti- k t jet clustering algorithm journal April 2008
The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics journal December 2021
Unsupervised outlier detection in heavy-ion collisions journal April 2021
A semi-supervised approach to dark matter searches in direct detection data with machine learning journal February 2022
Anomalous jet identification via sequence modeling journal August 2021
Publishing unbinned differential cross section results journal January 2022
A method to challenge symmetries in data with self-supervised learning journal August 2022
‘Flux+Mutability’: a conditional generative approach to one-class classification and anomaly detection journal November 2022
Unravelling physics beyond the standard model with classical and quantum anomaly detection journal November 2023
via machinae: Searching for stellar streams using unsupervised machine learning journal November 2021
Quantum-probabilistic Hamiltonian learning for generative modeling and anomaly detection journal December 2023
Properties of jet fragmentation using charged particles measured with the ATLAS detector in p p collisions at s = 13     TeV journal September 2019
Uncovering latent jet substructure journal September 2019
Transferability of deep learning models in searches for new physics at colliders journal February 2020
Cutting multiparticle correlators down to size journal February 2020
Searching for new physics with deep autoencoders journal April 2020
Anomaly detection with density estimation journal April 2020
Novelty detection meets collider physics journal April 2020
Simulation assisted likelihood-free anomaly detection journal May 2020
Unsupervised clustering for collider physics journal May 2021
Simulation-assisted decorrelation for resonant anomaly detection journal August 2021
Online-compatible unsupervised nonresonant anomaly detection journal March 2022
Anomaly detection in high-energy physics using a quantum autoencoder journal May 2022
Bump hunting in latent space journal June 2022
Creating simple, interpretable anomaly detectors for new physics in jet substructure journal August 2022
Classifying anomalies through outer density estimation journal September 2022
Self-supervised anomaly detection for new physics journal September 2022
Disentangling quarks and gluons in CMS open data journal November 2022
Anomaly detection under coordinate transformations journal January 2023
Variational autoencoders for anomalous jet tagging journal January 2023
Resonant anomaly detection without background sculpting journal June 2023
Anomaly detection search for new resonances decaying into a Higgs boson and a generic new particle X in hadronic final states using s=13  TeV pp collisions with the ATLAS detector journal September 2023
Tree-based algorithms for weakly supervised anomaly detection journal February 2024
Full phase space resonant anomaly detection journal March 2024
Combining resonant and tail-based anomaly detection journal May 2024
An effective field theory for collinear and soft gluons: Heavy to light decays journal May 2001
Soft-collinear factorization in effective field theory journal February 2002
Hard scattering factorization from effective field theory journal July 2002
Factorization for generic jet production journal June 2009
Hard-soft-collinear factorization to all orders journal November 2014
Building a better boosted top tagger journal February 2015
Decorrelated jet substructure tagging using adversarial neural networks journal October 2017
Learning to classify from impure samples with high-dimensional data journal July 2018
Extending the search for new resonances with machine learning journal January 2019
Learning new physics from a machine journal January 2019
Jet Topics: Disentangling Quarks and Gluons at Colliders journal June 2018
Anomaly Detection for Resonant New Physics with Machine Learning journal December 2018
Metric Space of Collider Events journal July 2019
OmniFold: A Method to Simultaneously Unfold All Observables journal May 2020
Dijet Resonance Search with Weak Supervision Using s = 13     TeV p p Collisions in the ATLAS Detector journal September 2020
Breakdown of the Narrow Width Approximation for New Physics journal September 2007
Jet substructure at the Large Hadron Collider journal December 2019
Towards jetography journal May 2010
FastJet user manual: (for version 3.0.2) journal March 2012
Guiding new physics searches with unsupervised learning journal March 2019
Finding new physics without learning about it: anomaly detection as a tool for searches at colliders journal January 2021
Learning multivariate new physics journal January 2021
Use of a generalized energy Mover’s distance in the search for rare phenomena at colliders journal February 2021
Comparing weak- and unsupervised methods for resonant anomaly detection journal July 2021
Erratum to: Finding new physics without learning about it: anomaly detection as a tool for searches at colliders journal November 2021
Anomaly detection from mass unspecific jet tagging journal February 2022
A data-directed paradigm for BSM searches: the bump-hunting example journal March 2022
Taming modeling uncertainties with mass unspecific supervised tagging journal March 2022
Learning new physics from an imperfect machine journal March 2022
Data-directed search for new physics based on symmetries of the SM journal June 2022
Learning new physics efficiently with nonparametric methods journal October 2022
GAN-AE: an anomaly detection algorithm for New Physics search in LHC data journal November 2023
The interplay of machine learning-based resonant anomaly detection methods journal March 2024
Adversarially Learned Anomaly Detection on CMS open data: re-discovering the top quark journal February 2021
Enhancing the hunt for new phenomena in dijet final states using anomaly detection filters at the high-luminosity large Hadron Collider journal March 2024
Perspectives on Higgs Physics II book November 1997
Better latent spaces for better autoencoders journal January 2021
The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider journal January 2022
Deep Set Auto Encoders for Anomaly Detection in Particle Physics journal January 2022
Rare and Different: Anomaly Scores from a combination of likelihood and out-of-distribution models to detect new physics at the LHC journal January 2022
Event Generation and Density Estimation with Surjective Normalizing Flows journal September 2022
Anomaly Awareness journal August 2023
What's anomalous in LHC jets? journal October 2023
High-dimensional and permutation invariant anomaly detection journal February 2024
QCD or what? journal January 2019
Invertible networks or partons to detector and back again journal January 2020
A normalized autoencoder for LHC triggers journal November 2023
Uncovering hidden new physics patterns in collider events using Bayesian probabilistic models conference February 2021
Improving Variational Autoencoders for New Physics Detection at the LHC With Normalizing Flows journal February 2022
CURTAINs for your sliding window: Constructing unobserved regions by transforming adjacent intervals journal March 2023
Event-Based Anomaly Detection for Searches for New Physics journal September 2022

Similar Records

Full phase space resonant anomaly detection
Journal Article · 2024 · Physical Review. D. · OSTI ID:2323378

Method to simultaneously facilitate all jet physics tasks
Journal Article · 2025 · Physical Review. D. · OSTI ID:2531018

Moment extraction using an unfolding protocol without binning
Journal Article · 2024 · Physical Review. D. · OSTI ID:2481387

Related Subjects