Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Nanosecond machine learning regression with deep boosted decision trees in FPGA for high energy physics

Journal Article · · Journal of Instrumentation

We present a novel application of the machine learning / artificial intelligence method called boosted decision trees to estimate physical quantities on field programmable gate arrays (FPGA). The software packagefwXmachinafeatures a new architecture called parallel decision paths that allows for deep decision trees with arbitrary number of input variables. It also features a new optimization scheme to use different numbers of bits for each input variable, which produces optimal physics results and ultraefficient FPGA resource utilization. Problems in high energy physics of proton collisions at the Large Hadron Collider (LHC) are considered. Estimation of missing transverse momentum (ETmiss) at the first level trigger system at the High Luminosity LHC (HL-LHC) experiments, with a simplified detector modeled by Delphes, is used to benchmark and characterize the firmware performance. The firmware implementation with a maximum depth of up to 10 using eight input variables of 16-bit precision gives a latency value of $$\mathcal{O}$$(10) ns, independent of the clock speed, and $$\mathcal{O}$$(0.1)% of the available FPGA resources without using digital signal processors.

Research Organization:
Univ. of Pittsburgh, PA (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
DOE Contract Number:
SC0007914
OSTI ID:
1979442
Journal Information:
Journal of Instrumentation, Vol. 17, Issue 09; ISSN 1748-0221
Publisher:
Institute of Physics (IOP)
Country of Publication:
United States
Language:
English

References (49)

Fast inference of Boosted Decision Trees in FPGAs for particle physics journal May 2020
Electron and photon performance measurements with the ATLAS detector using the 2015–2017 LHC proton-proton collision data journal December 2019
Artificial Neural Networks on FPGAs for Real-Time Energy Reconstruction of the ATLAS LAr Calorimeters journal October 2021
The anti- k t jet clustering algorithm journal April 2008
Development of FPGA-based neural network regression models for the ATLAS Phase-II barrel muon trigger upgrade journal January 2021
Fast inference of deep neural networks in FPGAs for particle physics journal July 2018
Reconstruction of hadronic decay products of tau leptons with the ATLAS experiment journal May 2016
Development of a resource-efficient FPGA-based neural network regression model for the ATLAS muon trigger upgrades journal June 2022
Compressing deep neural networks on FPGAs to binary and ternary precision with hls4ml journal December 2020
A comparative study of Higgs boson production from vector-boson fusion journal November 2021
Readiness of the ATLAS liquid argon calorimeter for LHC collisions journal August 2010
Performance of the ATLAS trigger system in 2015 journal May 2017
The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations journal July 2014
Performance of the upgraded PreProcessor of the ATLAS Level-1 Calorimeter Trigger journal November 2020
Performance of the CMS missing transverse momentum reconstruction in pp data at √ s = 8 TeV journal February 2015
Performance of missing transverse momentum reconstruction in proton-proton collisions at √ s = 13 TeV using the CMS detector journal July 2019
Performance of missing transverse momentum reconstruction with the ATLAS detector using proton–proton collisions at $$\sqrt{s}=13~\hbox {TeV}$$ s = 13 TeV journal November 2018
Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics journal January 2021
LHC Machine journal August 2008
The ATLAS Experiment at the CERN Large Hadron Collider journal August 2008
The CMS experiment at the CERN LHC journal August 2008
Energy linearity and resolution of the ATLAS electromagnetic barrel calorimeter in an electron test-beam
  • Aharrouche, M.; Colas, J.; Di Ciaccio, L.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 568, Issue 2 https://doi.org/10.1016/j.nima.2006.07.053
journal December 2006
The ATLAS Level-1 Calorimeter Trigger journal March 2008
Search for new phenomena in events with an energetic jet and missing transverse momentum in p p collisions at s = 13     TeV with the ATLAS detector journal June 2021
A neural network z -vertex trigger for Belle II journal May 2015
The Phase-2 Upgrade of the CMS Endcap Calorimeter null January 2017
Performance of the CMS Level-1 trigger in proton-proton collisions at √ s = 13 TeV journal October 2020
The catchment area of jets journal April 2008
Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors journal June 2021
Search for invisible Higgs boson decays in vector boson fusion at s = 13 TeV with the ATLAS detector journal June 2019
Search for invisible decays of a Higgs boson produced through vector boson fusion in proton-proton collisions at s = 13 TeV journal June 2019
DELPHES 3: a modular framework for fast simulation of a generic collider experiment journal February 2014
Performance of the ATLAS Level-1 topological trigger in Run 2 journal January 2022
Fast convolutional neural networks on FPGAs with hls4ml journal July 2021
fwXmachina example: Missing transverse energy regression dataset January 2022
Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics journal August 2021
Boosted Decision Trees in the Level-1 Muon Endcap Trigger at CMS journal September 2018
Real-time artificial intelligence for accelerator control: A study at the Fermilab Booster journal October 2021
Graph Neural Networks for Charged Particle Tracking on FPGAs journal March 2022
Performance of the missing transverse momentum triggers for the ATLAS detector during Run-2 data taking journal August 2020
An introduction to PYTHIA 8.2 journal June 2015
Pileup subtraction using jet areas journal January 2008
Performance of the ATLAS Trigger System in 2010 journal January 2012
Technical Design Report for the Phase-II Upgrade of the ATLAS TDAQ System null January 2017
The CMS trigger system journal January 2017
Electron and photon energy calibration with the ATLAS detector using 2015–2016 LHC proton-proton collision data journal March 2019
Accelerating Deep Neural Networks for Real-time Data Selection for High-resolution Imaging Particle Detectors conference June 2019
Searches for electroweak production of supersymmetric particles with compressed mass spectra in s = 13     TeV p p collisions with the ATLAS detector journal March 2020
Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference journal July 2021

Similar Records

SymbolNet: neural symbolic regression with adaptive dynamic pruning for compression
Journal Article · 2025 · Machine Learning: Science and Technology · OSTI ID:2507371

Graph Neural Networks for Charged Particle Tracking on FPGAs
Journal Article · 2022 · Frontiers in Big Data · OSTI ID:1859670

Fast inference of Boosted Decision Trees in FPGAs for particle physics
Journal Article · 2020 · Journal of Instrumentation · OSTI ID:1647080