skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Fast Inference of Deep Neural Networks in FPGAs for Particle Physics

Abstract

Recent results at the Large Hadron Collider (LHC) have pointed to enhanced physics capabilities through the improvement of the real-time event processing techniques. Machine learning methods are ubiquitous and have proven to be very powerful in LHC physics, and particle physics as a whole. However, exploration of the use of such techniques in low-latency, low-power FPGA hardware has only just begun. FPGA-based trigger and data acquisition (DAQ) systems have extremely low, sub-microsecond latency requirements that are unique to particle physics. We present a case study for neural network inference in FPGAs focusing on a classifier for jet substructure which would enable, among many other physics scenarios, searches for new dark sector particles and novel measurements of the Higgs boson. While we focus on a specific example, the lessons are far-reaching. We develop a package based on High-Level Synthesis (HLS) called hls4ml to build machine learning models in FPGAs. The use of HLS increases accessibility across a broad user community and allows for a drastic decrease in firmware development time. We map out FPGA resource usage and latency versus neural network hyperparameters to identify the problems in particle physics that would benefit from performing neural network inference with FPGAs. For ourmore » example jet substructure model, we fit well within the available resources of modern FPGAs with a latency on the scale of 100 ns.« less

Authors:
 [1];  [2];  [2];  [1];  [3];  [1];  [4];  [4];  [1];  [1];  [5]
  1. Fermilab
  2. MIT
  3. EIS Intl., Herndon
  4. CERN
  5. Illinois U., Chicago
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
OSTI Identifier:
1436700
Report Number(s):
FERMILAB-PUB-18-089-E; arXiv:1804.06913
1668914
DOE Contract Number:
AC02-07CH11359
Resource Type:
Journal Article
Resource Relation:
Journal Name: TBD
Country of Publication:
United States
Language:
English
Subject:
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; 72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Citation Formats

Duarte, Javier, Han, Song, Harris, Philip, Jindariani, Sergo, Kreinar, Edward, Kreis, Benjamin, Ngadiuba, Jennifer, Pierini, Maurizio, Rivera, Ryan, Tran, Nhan, and Wu, Zhenbin. Fast Inference of Deep Neural Networks in FPGAs for Particle Physics. United States: N. p., 2018. Web.
Duarte, Javier, Han, Song, Harris, Philip, Jindariani, Sergo, Kreinar, Edward, Kreis, Benjamin, Ngadiuba, Jennifer, Pierini, Maurizio, Rivera, Ryan, Tran, Nhan, & Wu, Zhenbin. Fast Inference of Deep Neural Networks in FPGAs for Particle Physics. United States.
Duarte, Javier, Han, Song, Harris, Philip, Jindariani, Sergo, Kreinar, Edward, Kreis, Benjamin, Ngadiuba, Jennifer, Pierini, Maurizio, Rivera, Ryan, Tran, Nhan, and Wu, Zhenbin. Mon . "Fast Inference of Deep Neural Networks in FPGAs for Particle Physics". United States. doi:. https://www.osti.gov/servlets/purl/1436700.
@article{osti_1436700,
title = {Fast Inference of Deep Neural Networks in FPGAs for Particle Physics},
author = {Duarte, Javier and Han, Song and Harris, Philip and Jindariani, Sergo and Kreinar, Edward and Kreis, Benjamin and Ngadiuba, Jennifer and Pierini, Maurizio and Rivera, Ryan and Tran, Nhan and Wu, Zhenbin},
abstractNote = {Recent results at the Large Hadron Collider (LHC) have pointed to enhanced physics capabilities through the improvement of the real-time event processing techniques. Machine learning methods are ubiquitous and have proven to be very powerful in LHC physics, and particle physics as a whole. However, exploration of the use of such techniques in low-latency, low-power FPGA hardware has only just begun. FPGA-based trigger and data acquisition (DAQ) systems have extremely low, sub-microsecond latency requirements that are unique to particle physics. We present a case study for neural network inference in FPGAs focusing on a classifier for jet substructure which would enable, among many other physics scenarios, searches for new dark sector particles and novel measurements of the Higgs boson. While we focus on a specific example, the lessons are far-reaching. We develop a package based on High-Level Synthesis (HLS) called hls4ml to build machine learning models in FPGAs. The use of HLS increases accessibility across a broad user community and allows for a drastic decrease in firmware development time. We map out FPGA resource usage and latency versus neural network hyperparameters to identify the problems in particle physics that would benefit from performing neural network inference with FPGAs. For our example jet substructure model, we fit well within the available resources of modern FPGAs with a latency on the scale of 100 ns.},
doi = {},
journal = {TBD},
number = ,
volume = ,
place = {United States},
year = {Mon Apr 16 00:00:00 EDT 2018},
month = {Mon Apr 16 00:00:00 EDT 2018}
}