DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: High-dimensional and permutation invariant anomaly detection

Journal Article · · SciPost Physics

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable properties such as permutation invariance and variable-length inputs becomes difficult within popular density estimation methods. In this work, we introduce a permutation-invariant density estimator for particle physics data based on diffusion models, specifically designed to handle variable-length inputs. We demonstrate the efficacy of our methodology by utilizing the learned density as a permutation-invariant anomaly detection score, effectively identifying jets with low likelihood under the background-only hypothesis. To validate our density estimation method, we investigate the ratio of learned densities and compare to those obtained by a supervised classification algorithm.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
2317701
Alternate ID(s):
OSTI ID: 2426880
Journal Information:
SciPost Physics, Journal Name: SciPost Physics Journal Issue: 3 Vol. 16; ISSN 2542-4653
Publisher:
Stichting SciPostCopyright Statement
Country of Publication:
Netherlands
Language:
English

References (73)

A family of embedded Runge-Kutta formulae journal March 1980
DCTRGAN: improving the precision of generative models with reweighting journal November 2020
Score-based generative models for calorimeter shower simulation journal November 2022
Anomalies, Representations, and Self-Supervision journal January 2023
Via Machinae 2.0: Full-Sky, Model-Agnostic Search for Stellar Streams in Gaia DR2 journal February 2024
What's anomalous in LHC jets? journal October 2023
Learning the language of QCD jets with transformers journal June 2023
Classifying anomalies through outer density estimation journal September 2022
Anomaly detection under coordinate transformations journal January 2023
Latent Space Refinement for Deep Generative Models text January 2021
Comparing weak- and unsupervised methods for resonant anomaly detection journal July 2021
PYTHIA 6.4 physics and manual journal May 2006
Fast point cloud generation with diffusion models in high energy physics journal August 2023
Jet Diffusion versus JetGPT -- Modern Networks for the LHC preprint January 2023
Discerning secluded sector gauge structures journal April 2011
The motivation and status of two-body resonance decays after the LHC Run 2 and beyond journal April 2020
Tag N’ Train: a technique to train improved classifiers on unlabeled data journal January 2021
JetFlow: Generating Jets with Conditioned and Mass Constrained Normalising Flows preprint January 2022
Echoes of a hidden valley at hadron colliders journal August 2007
Novelty detection meets collider physics journal April 2020
On the Problem of the Most Efficient Tests of Statistical Hypotheses
  • Neyman, J.; Pearson, E. S.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 231, Issue 694-706 https://doi.org/10.1098/rsta.1933.0009
journal January 1933
Machine learning in the search for new fundamental physics journal May 2022
Inductive simulation of calorimeter showers with normalizing flows journal February 2024
New features in Delphes 3 journal May 2015
Attention Is All You Need preprint January 2017
A robust anomaly finder based on autoencoders preprint January 2019
The Machine Learning landscape of top taggers journal January 2019
Some Practical Runge-Kutta Formulas journal January 1986
Dispelling the N3 myth for the kt jet-finder journal September 2006
Anomaly detection search for new resonances decaying into a Higgs boson and a generic new particle X in hadronic final states using s=13  TeV pp collisions with the ATLAS detector journal September 2023
The Unexplored Landscape of Two-body Resonances journal January 2019
Extending the search for new resonances with machine learning journal January 2019
Elsa: enhanced latent spaces for improved collider simulations journal September 2023
Anomaly detection with density estimation journal April 2020
QCD or what? journal January 2019
Perturbative benchmark models for a dark shower search program journal June 2021
The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider journal January 2022
Classification without labels: learning from mixed samples in high energy physics journal October 2017
CaloClouds: fast geometry-independent highly-granular calorimeter simulation journal November 2023
via machinae: Searching for stellar streams using unsupervised machine learning journal November 2021
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
DELPHES 3: A modular framework for fast-simulation of generic collider experiments journal June 2014
Score-Based Generative Modeling through Stochastic Differential Equations preprint January 2020
Normalizing Flows: An Introduction and Review of Current Methods journal January 2020
Visible effects of invisible Hidden Valley radiation journal September 2010
The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics journal December 2021
Weakly-Supervised Anomaly Detection in the Milky Way posted_content May 2023
Fast and accurate simulations of calorimeter showers with normalizing flows journal June 2023
A Connection Between Score Matching and Denoising Autoencoders journal July 2011
Learning new physics from a machine journal January 2019
IRC-Safe Graph Autoencoder for Unsupervised Anomaly Detection journal July 2022
Event Generation and Density Estimation with Surjective Normalizing Flows journal September 2022
Generative Adversarial Networks preprint January 2014
An introduction to PYTHIA 8.2 journal June 2015
A normalized autoencoder for LHC triggers journal November 2023
Dijet Resonance Search with Weak Supervision Using s = 13     TeV p p Collisions in the ATLAS Detector journal September 2020
Anomalous jet identification via sequence modeling journal August 2021
Deep Residual Learning for Image Recognition conference June 2016
Anomaly detection with convolutional Graph Neural Networks journal August 2021
Searching for new physics with deep autoencoders journal April 2020
Top Quark Tagging Reference Dataset dataset January 2019
The anti- k t jet clustering algorithm journal April 2008
PC-JeDi: Diffusion for particle cloud generation in high energy physics journal January 2024
Deep Sets preprint January 2017
CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing Flows preprint January 2021
FastJet user manual: (for version 3.0.2) journal March 2012
Variational Inference with Normalizing Flows journal May 2015
How to understand limitations of generative networks journal January 2024
Search for New Phenomena in Two-Body Invariant Mass Distributions Using Unsupervised Machine Learning for Anomaly Detection at s=13  TeV with the ATLAS Detector journal February 2024
L2LFlows: generating high-fidelity 3D calorimeter images journal October 2023
Anomaly Detection for Resonant New Physics with Machine Learning journal December 2018
CaloFlow for CaloChallenge Dataset 1 preprint January 2022
JUNIPR: a framework for unsupervised machine learning in particle physics journal February 2019

Similar Records

Self-Supervised Anomaly Detection via Neural Autoregressive Flows with Active Learning
Conference · 2021 · OSTI ID:2278928

Scalable deep learning for watershed model calibration
Journal Article · 2022 · Frontiers in Earth Science · OSTI ID:1900374

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
Conference · 2022 · 2022 International Joint Conference on Neural Networks (IJCNN) · OSTI ID:1905117

Related Subjects