skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Pileup Mitigation with Machine Learning (PUMML)

Abstract

Pileup involves the contamination of the energy distribution arising from the primary collision of interest (leading vertex) by radiation from soft collisions (pileup). We develop a new technique for removing this contamination using machine learning and convolutional neural networks. The network takes as input the energy distribution of charged leading vertex particles, charged pileup particles, and all neutral particles and outputs the energy distribution of particles coming from leading vertex alone. The PUMML algorithm performs remarkably well at eliminating pileup distortion on a wide range of simple and complex jet observables. We test the robustness of the algorithm in a number of ways and discuss how the network can be trained directly on data.

Authors:
 [1];  [1];  [2];  [3]
  1. Massachusetts Inst. of Technology (MIT), Cambridge, MA (United States)
  2. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  3. Harvard Univ., Cambridge, MA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP); USDOE Office of Science (SC), Nuclear Physics (NP)
OSTI Identifier:
1485069
Grant/Contract Number:  
AC02-05CH11231; SC0013607; SC0011090; SC0012567
Resource Type:
Accepted Manuscript
Journal Name:
Journal of High Energy Physics (Online)
Additional Journal Information:
Journal Name: Journal of High Energy Physics (Online); Journal Volume: 2017; Journal Issue: 12; Journal ID: ISSN 1029-8479
Publisher:
Springer Berlin
Country of Publication:
United States
Language:
English
Subject:
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS; Jets

Citation Formats

Komiske, Patrick T., Metodiev, Eric M., Nachman, Benjamin, and Schwartz, Matthew D. Pileup Mitigation with Machine Learning (PUMML). United States: N. p., 2017. Web. https://doi.org/10.1007/jhep12(2017)051.
Komiske, Patrick T., Metodiev, Eric M., Nachman, Benjamin, & Schwartz, Matthew D. Pileup Mitigation with Machine Learning (PUMML). United States. https://doi.org/10.1007/jhep12(2017)051
Komiske, Patrick T., Metodiev, Eric M., Nachman, Benjamin, and Schwartz, Matthew D. Tue . "Pileup Mitigation with Machine Learning (PUMML)". United States. https://doi.org/10.1007/jhep12(2017)051. https://www.osti.gov/servlets/purl/1485069.
@article{osti_1485069,
title = {Pileup Mitigation with Machine Learning (PUMML)},
author = {Komiske, Patrick T. and Metodiev, Eric M. and Nachman, Benjamin and Schwartz, Matthew D.},
abstractNote = {Pileup involves the contamination of the energy distribution arising from the primary collision of interest (leading vertex) by radiation from soft collisions (pileup). We develop a new technique for removing this contamination using machine learning and convolutional neural networks. The network takes as input the energy distribution of charged leading vertex particles, charged pileup particles, and all neutral particles and outputs the energy distribution of particles coming from leading vertex alone. The PUMML algorithm performs remarkably well at eliminating pileup distortion on a wide range of simple and complex jet observables. We test the robustness of the algorithm in a number of ways and discuss how the network can be trained directly on data.},
doi = {10.1007/jhep12(2017)051},
journal = {Journal of High Energy Physics (Online)},
number = 12,
volume = 2017,
place = {United States},
year = {2017},
month = {12}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 25 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: An illustration of the PUMML framework. The input is a three-channel image: blue/purple represents charged radiation from the leading vertex, green is charged pileup radiation, and yellow/orange/red is the total neutral radiation. The resolution of the charged images is higher than for the neutral one. These images aremore » fed into a convolutional layer with several filters whose value at each pixel is a function of a patch around that pixel location in the input images. The output is an image combining the pixels of each filter to one output pixel.« less

Save / Share:

Works referenced in this record:

The anti- k t jet clustering algorithm
journal, April 2008


Particle-level pileup subtraction for jets and jet shapes
journal, June 2014

  • Berta, Peter; Spousta, Martin; Miller, David W.
  • Journal of High Energy Physics, Vol. 2014, Issue 6
  • DOI: 10.1007/JHEP06(2014)092

Deep-learning top taggers or the end of QCD?
journal, May 2017

  • Kasieczka, Gregor; Plehn, Tilman; Russell, Michael
  • Journal of High Energy Physics, Vol. 2017, Issue 5
  • DOI: 10.1007/JHEP05(2017)006

Deep learning in color: towards automated quark/gluon jet discrimination
journal, January 2017

  • Komiske, Patrick T.; Metodiev, Eric M.; Schwartz, Matthew D.
  • Journal of High Energy Physics, Vol. 2017, Issue 1
  • DOI: 10.1007/JHEP01(2017)110

Topological cell clustering in the ATLAS calorimeters and its performance in LHC Run 1
journal, July 2017


FastJet user manual: (for version 3.0.2)
journal, March 2012


Simulation of Pile-up in the ATLAS Experiment
journal, June 2014


Jet trimming
journal, February 2010

  • Krohn, David; Thaler, Jesse; Wang, Lian-Tao
  • Journal of High Energy Physics, Vol. 2010, Issue 2
  • DOI: 10.1007/JHEP02(2010)084

Jet Substructure as a New Higgs-Search Channel at the Large Hadron Collider
journal, June 2008


Soft drop
journal, May 2014

  • Larkoski, Andrew J.; Marzani, Simone; Soyez, Gregory
  • Journal of High Energy Physics, Vol. 2014, Issue 5
  • DOI: 10.1007/JHEP05(2014)146

Jet energy measurement with the ATLAS detector in proton-proton collisions at $\sqrt{\mathrm{s}}=7\ \mathrm{TeV}$
journal, March 2013


Determination of jet energy calibration and transverse momentum resolution in CMS
journal, November 2011


Topological cell clustering in the ATLAS calorimeters and its performance in LHC Run 1
text, January 2017

  • Aad, Georges; Abbott, Brad; Abdallah, Jalal
  • Deutsches Elektronen-Synchrotron, DESY, Hamburg
  • DOI: 10.3204/pubdb-2018-00312

Energy correlation functions for jet substructure
journal, June 2013

  • Larkoski, Andrew J.; Salam, Gavin P.; Thaler, Jesse
  • Journal of High Energy Physics, Vol. 2013, Issue 6
  • DOI: 10.1007/JHEP06(2013)108

Identification and rejection of pile-up jets at high pseudorapidity with the ATLAS detector
journal, September 2017


Jet observables without jet algorithms
journal, April 2014

  • Bertolini, Daniele; Chan, Tucker; Thaler, Jesse
  • Journal of High Energy Physics, Vol. 2014, Issue 4
  • DOI: 10.1007/JHEP04(2014)013

Jet-images — deep learning edition
journal, July 2016

  • de Oliveira, Luke; Kagan, Michael; Mackey, Lester
  • Journal of High Energy Physics, Vol. 2016, Issue 7
  • DOI: 10.1007/JHEP07(2016)069

Weakly supervised classification in high energy physics
journal, May 2017

  • Dery, Lucio Mwinmaarong; Nachman, Benjamin; Rubbo, Francesco
  • Journal of High Energy Physics, Vol. 2017, Issue 5
  • DOI: 10.1007/JHEP05(2017)145

Jet-images: computer vision inspired techniques for jet tagging
journal, February 2015

  • Cogan, Josh; Kagan, Michael; Strauss, Emanuel
  • Journal of High Energy Physics, Vol. 2015, Issue 2
  • DOI: 10.1007/JHEP02(2015)118

Performance of pile-up mitigation techniques for jets in $$pp$$ p p collisions at $$\sqrt{s}=8$$ s = 8  TeV using the ATLAS detector
journal, October 2016


SoftKiller, a particle-level pileup removal method
journal, February 2015


ATLAS Simulation using Real Data: Embedding and Overlay
journal, October 2017


Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis
journal, September 2017

  • de Oliveira, Luke; Paganini, Michela; Nachman, Benjamin
  • Computing and Software for Big Science, Vol. 1, Issue 1
  • DOI: 10.1007/s41781-017-0004-6

Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
conference, December 2015

  • He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing
  • 2015 IEEE International Conference on Computer Vision (ICCV)
  • DOI: 10.1109/ICCV.2015.123

An introduction to PYTHIA 8.2
journal, June 2015

  • Sjöstrand, Torbjörn; Ask, Stefan; Christiansen, Jesper R.
  • Computer Physics Communications, Vol. 191
  • DOI: 10.1016/j.cpc.2015.01.024

Pileup subtraction using jet areas
journal, January 2008


Description and performance of track and primary-vertex reconstruction with the CMS tracker
journal, October 2014


Theano: A CPU and GPU Math Compiler in Python
conference, January 2010


    Works referencing / citing this record:

    Boosting H → b b ¯ $$ H\to b\overline{b} $$ with machine learning
    journal, October 2018

    • Lin, Joshua; Freytsis, Marat; Moult, Ian
    • Journal of High Energy Physics, Vol. 2018, Issue 10
    • DOI: 10.1007/jhep10(2018)101

    binary junipr: An Interpretable Probabilistic Model for Discrimination
    journal, October 2019


    Deep-learning jets with uncertainties and more
    journal, January 2020


    JUNIPR: a framework for unsupervised machine learning in particle physics
    journal, February 2019


    Quark jet versus gluon jet: fully-connected neural networks with high-level features
    journal, June 2019

    • Luo, Hui; Luo, Ming-Xing; Wang, Kai
    • Science China Physics, Mechanics & Astronomy, Vol. 62, Issue 9
    • DOI: 10.1007/s11433-019-9390-8

    Pileup mitigation at the Large Hadron Collider with graph neural networks
    journal, July 2019

    • Arjona Martínez, J.; Cerri, O.; Spiropulu, M.
    • The European Physical Journal Plus, Vol. 134, Issue 7
    • DOI: 10.1140/epjp/i2019-12710-3

    Jet charge and machine learning
    journal, October 2018

    • Fraser, Katherine; Schwartz, Matthew D.
    • Journal of High Energy Physics, Vol. 2018, Issue 10
    • DOI: 10.1007/jhep10(2018)093

    Energy flow polynomials: a complete linear basis for jet substructure
    journal, April 2018

    • Komiske, Patrick T.; Metodiev, Eric M.; Thaler, Jesse
    • Journal of High Energy Physics, Vol. 2018, Issue 4
    • DOI: 10.1007/jhep04(2018)013

    Quark-gluon tagging: Machine learning vs detector
    journal, January 2019


    Learning representations of irregular particle-detector geometry with distance-weighted graph networks
    journal, July 2019


    QCD or what?
    journal, January 2019


    Metric Space of Collider Events
    journal, July 2019


    Reweighting a parton shower using a neural network: the final-state case
    journal, January 2019

    • Bothmann, Enrico; Del Debbio, Luigi
    • Journal of High Energy Physics, Vol. 2019, Issue 1
    • DOI: 10.1007/jhep01(2019)033

    Jet grooming through reinforcement learning
    journal, July 2019


    Jet substructure at the Large Hadron Collider
    journal, December 2019


    CapsNets continuing the convolutional quest
    journal, January 2020


    Quark jet versus gluon jet: fully-connected neural networks with high-level features
    journal, June 2019

    • Luo, Hui; Luo, Ming-Xing; Wang, Kai
    • Science China Physics, Mechanics & Astronomy, Vol. 62, Issue 9
    • DOI: 10.1007/s11433-019-9390-8

    Subtracted cumulants: Mitigating large background in jet substructure
    journal, October 2019


    Supervised Deep Learning in High Energy Phenomenology: a Mini Review
    journal, August 2019


    Lund jet images from generative and cycle-consistent adversarial networks
    journal, November 2019


    Learning representations of irregular particle-detector geometry with distance-weighted graph networks
    journal, July 2019


    Energy flow networks: deep sets for particle jets
    journal, January 2019

    • Komiske, Patrick T.; Metodiev, Eric M.; Thaler, Jesse
    • Journal of High Energy Physics, Vol. 2019, Issue 1
    • DOI: 10.1007/jhep01(2019)121

    An operational definition of quark and gluon jets
    journal, November 2018

    • Komiske, Patrick T.; Metodiev, Eric M.; Thaler, Jesse
    • Journal of High Energy Physics, Vol. 2018, Issue 11
    • DOI: 10.1007/jhep11(2018)059

    The Lund jet plane
    journal, December 2018

    • Dreyer, Frédéric A.; Salam, Gavin P.; Soyez, Grégory
    • Journal of High Energy Physics, Vol. 2018, Issue 12
    • DOI: 10.1007/jhep12(2018)064

    Deep-learned Top Tagging with a Lorentz Layer
    journal, January 2018


    Learning to classify from impure samples with high-dimensional data
    journal, July 2018


    Interpretable deep learning for two-prong jet classification with jet spectra
    journal, July 2019

    • Chakraborty, Amit; Lim, Sung Hak; Nojiri, Mihoko M.
    • Journal of High Energy Physics, Vol. 2019, Issue 7
    • DOI: 10.1007/jhep07(2019)135

    An operational definition of quark and gluon jets
    journal, November 2018

    • Komiske, Patrick T.; Metodiev, Eric M.; Thaler, Jesse
    • Journal of High Energy Physics, Vol. 2018, Issue 11
    • DOI: 10.1007/jhep11(2018)059