skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: HPC resource integration into CMS Computing via HEPCloud

Journal Article · · EPJ Web of Conferences

The higher energy and luminosity from the LHC in Run 2 have put increased pressure on CMS computing resources. Extrapolating to even higher luminosities (and thus higher event complexities and trigger rates) beyond Run 3, it becomes clear that simply scaling up the the current model of CMS computing alone will become economically unfeasible. High Performance Computing (HPC) facilities, widely used in scientific computing outside of HEP, have the potential to help fill the gap. Here we describe the U.S.CMS efforts to integrate US HPC resources into CMS Computing via the HEPCloud project at Fermilab. We present advancements in our ability to use NERSC resources at scale and efforts to integrate other HPC sites as well. We present experience in the elastic use of HPC resources, quickly scaling up use when so required by CMS workflows. We also present performance studies of the CMS multi-threaded framework on both Haswell and KNL HPC resources.

Research Organization:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
CMS CERN-LHC
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1497404
Report Number(s):
FERMILAB-CONF-18-630-CD; oai:inspirehep.net:1722477
Journal Information:
EPJ Web of Conferences, Vol. 214; Conference: 23rd International Conference on Computing in High Energy and Nuclear Physics, Sofia, Bulgaria, 07/09-07/13/2018; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (4)

CMS use of allocation based HPC resources journal October 2017
XSEDE: Accelerating Scientific Discovery journal September 2014
Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits journal October 2017
Accessing opportunistic resources with Bosco journal June 2014

Similar Records

CMS use of allocation based HPC resources
Journal Article · Tue Nov 21 00:00:00 EST 2017 · Journal of Physics. Conference Series · OSTI ID:1497404

Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility
Journal Article · Sun Oct 01 00:00:00 EDT 2017 · Journal of Physics. Conference Series · OSTI ID:1497404

STAR Data Production Workflow on HPC: Lessons Learned & Best Practices
Conference · Sun Mar 10 00:00:00 EST 2019 · OSTI ID:1497404

Related Subjects