HPC resource integration into CMS Computing via HEPCloud
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Univ. of Nebraska, Lincoln, NE (United States)
The higher energy and luminosity from the LHC in Run 2 have put increased pressure on CMS computing resources. Extrapolating to even higher luminosities (and thus higher event complexities and trigger rates) beyond Run 3, it becomes clear that simply scaling up the the current model of CMS computing alone will become economically unfeasible. High Performance Computing (HPC) facilities, widely used in scientific computing outside of HEP, have the potential to help fill the gap. Here we describe the U.S.CMS efforts to integrate US HPC resources into CMS Computing via the HEPCloud project at Fermilab. We present advancements in our ability to use NERSC resources at scale and efforts to integrate other HPC sites as well. We present experience in the elastic use of HPC resources, quickly scaling up use when so required by CMS workflows. We also present performance studies of the CMS multi-threaded framework on both Haswell and KNL HPC resources.
- Research Organization:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- Contributing Organization:
- CMS CERN-LHC
- Grant/Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1497404
- Report Number(s):
- FERMILAB-CONF-18-630-CD; oai:inspirehep.net:1722477
- Journal Information:
- EPJ Web of Conferences, Vol. 214; Conference: 23rd International Conference on Computing in High Energy and Nuclear Physics, Sofia, Bulgaria, 07/09-07/13/2018; ISSN 2100-014X
- Publisher:
- EDP SciencesCopyright Statement
- Country of Publication:
- United States
- Language:
- English
CMS use of allocation based HPC resources
|
journal | October 2017 |
XSEDE: Accelerating Scientific Discovery
|
journal | September 2014 |
Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits
|
journal | October 2017 |
Accessing opportunistic resources with Bosco
|
journal | June 2014 |
Similar Records
Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility
STAR Data Production Workflow on HPC: Lessons Learned & Best Practices