Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Reaching new peaks for the future of the CMS HTCondor Global Pool

Journal Article · · EPJ Web of Conferences (Online)
 [1];  [2];  [3];  [2];  [4];  [5];  [3];  [6];  [3]
  1. Research Centre for Energy, Environment and Technology (CIEMAT), Madrid (Spain); Port d’Informació Cientifica (PIC), Barcelona (Spain)
  2. Univ. of California San Diego, La Jolla, CA (United States)
  3. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  4. National Centre for Physics, Islamabad (Pakistan)
  5. Univ. of Notre Dame, IN (United States)
  6. European Organization for Nuclear Research (CERN), Meyrin (Switzerland)
+ Show Author Affiliations
The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 350k CPU cores, is employed to successfully manage the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict a noticeable expansion in the amount of CPU that will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring and expanding the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high effciency in our workload scheduling and resource utilization.
Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
CMS Collaboration
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1831915
Alternate ID(s):
OSTI ID: 23172510
Report Number(s):
FERMILAB-PUB--21-429-CMS; oai:inspirehep.net:1911734
Journal Information:
EPJ Web of Conferences (Online), Journal Name: EPJ Web of Conferences (Online) Vol. 251; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (6)

BOINC: A Platform for Volunteer Computing journal November 2019
Experience with dynamic resource provisioning of the CMS online cluster using a cloud overlay journal January 2019
Exploiting private and commercial clouds to generate on-demand CMS computing facilities with DODAS journal January 2019
Dynamic Integration and Management of Opportunistic Resources for HEP journal January 2019
Sharing server nodes for storage and computer journal January 2019
CMS strategy for HPC resource exploitation journal January 2020

Similar Records

Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
Journal Article · Mon Sep 16 20:00:00 EDT 2019 · EPJ Web of Conferences · OSTI ID:1574964
Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits
Journal Article · Tue Nov 21 19:00:00 EST 2017 · Journal of Physics. Conference Series · OSTI ID:1420915
Optimization of distributed compute resources utilization in the CMS Global Pool
Conference · Tue Dec 31 19:00:00 EST 2024 · EPJ Web Conf. · OSTI ID:3019446

Related Subjects

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS