Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool

Journal Article · · EPJ Web of Conferences
 [1];  [2];  [3];  [4];  [5];  [6];  [7];  [6];  [8];  [8];  [6]
  1. Research Centre for Energy, Environment and Technology (CIEMAT), Madrid (Spain); Spain Port d’Informació Cientifica (PIC), Barcelona (Spain)
  2. Univ. of Nebraska, Lincoln, NE (United States)
  3. Benemérita Univ. Autónoma de Puebla, Puebla (México)
  4. Univ. of Notre Dame, IN (United States)
  5. Univ. of Sofia, Sofia (Bulgaria)
  6. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  7. Univ. of Malaya, Kuala Lumpur (Malaysia)
  8. Univ. of California, San Diego, CA (United States)
The CMS Submission Infrastructure Global Pool, built on Glidein-WMS andHTCondor, is a worldwide distributed dynamic pool responsible for the allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Plmust be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submissi.A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalabilitydimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams.
Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Contributing Organization:
CMS Collaboration
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1574964
Report Number(s):
FERMILAB-CONF--19-553-SCD; oai:inspirehep.net:1760907
Journal Information:
EPJ Web of Conferences, Journal Name: EPJ Web of Conferences Vol. 214; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

Similar Records

Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits
Journal Article · Tue Nov 21 23:00:00 EST 2017 · Journal of Physics. Conference Series · OSTI ID:1420915

Evolution of the pilot infrastructure of CMS: towards a single glideinWMS pool
Conference · Tue Dec 31 23:00:00 EST 2013 · J.Phys.Conf.Ser. · OSTI ID:1295710

glideinWMS - A generic pilot-based Workload Management System
Journal Article · Sat Sep 01 00:00:00 EDT 2007 · OSTI ID:925632

Related Subjects