DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Comparing weak- and unsupervised methods for resonant anomaly detection

Abstract

Anomaly detection techniques are growing in importance at the Large Hadron Collider (LHC), motivated by the increasing need to search for new physics in a model-agnostic way. In this work, we provide a detailed comparative study between a well-studied unsupervised method called the autoencoder (AE) and a weakly-supervised approach based on the Classification Without Labels (CWoLa) technique. We examine the ability of the two methods to identify a new physics signal at different cross sections in a fully hadronic resonance search. By construction, the AE classification performance is independent of the amount of injected signal. In contrast, the CWoLa performance improves with increasing signal abundance. When integrating these approaches with a complete background estimate, we find that the two methods have complementary sensitivity. In particular, CWoLa is effective at finding diverse and moderately rare signals while the AE can provide sensitivity to very rare signals, but only with certain topologies. We therefore demonstrate that both techniques are complementary and can be used together for anomaly detection at the LHC.

Authors:
; ORCiD logo; ;
Publication Date:
Research Org.:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), High Energy Physics (HEP)
OSTI Identifier:
1808209
Alternate Identifier(s):
OSTI ID: 1819743; OSTI ID: 1820604
Grant/Contract Number:  
AC02-05CH11231; AC02-76SF00515; DOE-SC0010008
Resource Type:
Published Article
Journal Name:
European Physical Journal. C, Particles and Fields
Additional Journal Information:
Journal Name: European Physical Journal. C, Particles and Fields Journal Volume: 81 Journal Issue: 7; Journal ID: ISSN 1434-6044
Publisher:
Springer Science + Business Media
Country of Publication:
Germany
Language:
English
Subject:
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Citation Formats

Collins, Jack H., Martín-Ramiro, Pablo, Nachman, Benjamin, and Shih, David. Comparing weak- and unsupervised methods for resonant anomaly detection. Germany: N. p., 2021. Web. doi:10.1140/epjc/s10052-021-09389-x.
Collins, Jack H., Martín-Ramiro, Pablo, Nachman, Benjamin, & Shih, David. Comparing weak- and unsupervised methods for resonant anomaly detection. Germany. https://doi.org/10.1140/epjc/s10052-021-09389-x
Collins, Jack H., Martín-Ramiro, Pablo, Nachman, Benjamin, and Shih, David. Thu . "Comparing weak- and unsupervised methods for resonant anomaly detection". Germany. https://doi.org/10.1140/epjc/s10052-021-09389-x.
@article{osti_1808209,
title = {Comparing weak- and unsupervised methods for resonant anomaly detection},
author = {Collins, Jack H. and Martín-Ramiro, Pablo and Nachman, Benjamin and Shih, David},
abstractNote = {Anomaly detection techniques are growing in importance at the Large Hadron Collider (LHC), motivated by the increasing need to search for new physics in a model-agnostic way. In this work, we provide a detailed comparative study between a well-studied unsupervised method called the autoencoder (AE) and a weakly-supervised approach based on the Classification Without Labels (CWoLa) technique. We examine the ability of the two methods to identify a new physics signal at different cross sections in a fully hadronic resonance search. By construction, the AE classification performance is independent of the amount of injected signal. In contrast, the CWoLa performance improves with increasing signal abundance. When integrating these approaches with a complete background estimate, we find that the two methods have complementary sensitivity. In particular, CWoLa is effective at finding diverse and moderately rare signals while the AE can provide sensitivity to very rare signals, but only with certain topologies. We therefore demonstrate that both techniques are complementary and can be used together for anomaly detection at the LHC.},
doi = {10.1140/epjc/s10052-021-09389-x},
journal = {European Physical Journal. C, Particles and Fields},
number = 7,
volume = 81,
place = {Germany},
year = {Thu Jul 15 00:00:00 EDT 2021},
month = {Thu Jul 15 00:00:00 EDT 2021}
}

Works referenced in this record:

QCD or what?
journal, January 2019


The anti- k t jet clustering algorithm
journal, April 2008


Quasi-model-independent search for new physics at large transverse momentum
journal, June 2001


Model-independent and quasi-model-independent search for new physics at CDF
journal, July 2008


Maximizing boosted top identification by minimizing N-subjettiness
journal, February 2012


A brief introduction to PYTHIA 8.1
journal, June 2008

  • Sjöstrand, Torbjörn; Mrenna, Stephen; Skands, Peter
  • Computer Physics Communications, Vol. 178, Issue 11
  • DOI: 10.1016/j.cpc.2008.01.036

Simulation assisted likelihood-free anomaly detection
journal, May 2020


Learning new physics from a machine
journal, January 2019


Variational autoencoders for new physics mining at the Large Hadron Collider
journal, May 2019

  • Cerri, Olmo; Nguyen, Thong Q.; Pierini, Maurizio
  • Journal of High Energy Physics, Vol. 2019, Issue 5
  • DOI: 10.1007/JHEP05(2019)036

DELPHES 3: a modular framework for fast simulation of a generic collider experiment
journal, February 2014

  • de Favereau, J.; Delaere, C.; Demin, P.
  • Journal of High Energy Physics, Vol. 2014, Issue 2
  • DOI: 10.1007/JHEP02(2014)057

Adversarially-trained autoencoders for robust unsupervised new physics searches
journal, October 2019

  • Blance, Andrew; Spannowsky, Michael; Waite, Philip
  • Journal of High Energy Physics, Vol. 2019, Issue 10
  • DOI: 10.1007/JHEP10(2019)047

Multivariate discrimination and the Higgs+W/Z search
journal, April 2011

  • Gallicchio, Jason; Huth, John; Kagan, Michael
  • Journal of High Energy Physics, Vol. 2011, Issue 4
  • DOI: 10.1007/JHEP04(2011)069

FastJet user manual: (for version 3.0.2)
journal, March 2012


Anomaly Detection for Resonant New Physics with Machine Learning
journal, December 2018


A generic anti-QCD jet tagger
journal, November 2017

  • Aguilar-Saavedra, J. A.; Collins, Jack; Mishra, Rashmish K.
  • Journal of High Energy Physics, Vol. 2017, Issue 11
  • DOI: 10.1007/JHEP11(2017)163

A general search for new phenomena at HERA
journal, April 2009


Uncovering latent jet substructure
journal, September 2019


Anomaly detection with density estimation
journal, April 2020


Guiding new physics searches with unsupervised learning
journal, March 2019


Global search for new physics with 2.0 fb 1 at CDF
journal, January 2009


Identifying boosted objects with N-subjettiness
journal, March 2011


A general search for new phenomena in ep scattering at HERA
journal, November 2004


Quasi-Model-Independent Search for New High p T Physics at D0
journal, April 2001


Extending the search for new resonances with machine learning
journal, January 2019


Transferability of deep learning models in searches for new physics at colliders
journal, February 2020


A strategy for a general search for new phenomena using data-derived signal regions and its application within the ATLAS experiment
journal, February 2019


Search for new physics in e μ X data at DØ using SLEUTH: A quasi-model-independent search strategy for new physics
journal, October 2000