skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: CMS Readiness for Multi-Core Workload Scheduling

Abstract

In the present run of the LHC, CMS data reconstruction and simulation algorithms benefit greatly from being executed as multiple threads running on several processor cores. The complexity of the Run 2 events requires parallelization of the code to reduce the memory-per- core footprint constraining serial execution programs, thus optimizing the exploitation of present multi-core processor architectures. The allocation of computing resources for multi-core tasks, however, becomes a complex problem in itself. The CMS workload submission infrastructure employs multi-slot partitionable pilots, built on HTCondor and GlideinWMS native features, to enable scheduling of single and multi-core jobs simultaneously. This provides a solution for the scheduling problem in a uniform way across grid sites running a diversity of gateways to compute resources and batch system technologies. This paper presents this strategy and the tools on which it has been implemented. The experience of managing multi-core resources at the Tier-0 and Tier-1 sites during 2015, along with the deployment phase to Tier-2 sites during early 2016 is reported. The process of performance monitoring and optimization to achieve efficient and flexible use of the resources is also described.

Authors:
 [1];  [2];  [1];  [3];  [4];  [5];  [6]
  1. Madrid, CIEMAT
  2. Caltech
  3. NCP, Islamabad
  4. UC, San Diego
  5. Fermilab
  6. CLMI, Sofia
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
OSTI Identifier:
1420916
Report Number(s):
FERMILAB-CONF-16-755-CD
1638487
DOE Contract Number:  
AC02-07CH11359
Resource Type:
Conference
Resource Relation:
Journal Name: J.Phys.Conf.Ser.; Journal Volume: 898; Journal Issue: 5; Conference: 22nd International Conference on Computing in High Energy and Nuclear Physics, San Francisco, CA, 10/10-10/14/2016
Country of Publication:
United States
Language:
English

Citation Formats

Perez-Calero Yzquierdo, A., Balcas, J., Hernandez, J., Aftab Khan, F., Letts, J., Mason, D., and Verguilov, V.. CMS Readiness for Multi-Core Workload Scheduling. United States: N. p., 2017. Web. doi:10.1088/1742-6596/898/5/052030.
Perez-Calero Yzquierdo, A., Balcas, J., Hernandez, J., Aftab Khan, F., Letts, J., Mason, D., & Verguilov, V.. CMS Readiness for Multi-Core Workload Scheduling. United States. doi:10.1088/1742-6596/898/5/052030.
Perez-Calero Yzquierdo, A., Balcas, J., Hernandez, J., Aftab Khan, F., Letts, J., Mason, D., and Verguilov, V.. Wed . "CMS Readiness for Multi-Core Workload Scheduling". United States. doi:10.1088/1742-6596/898/5/052030. https://www.osti.gov/servlets/purl/1420916.
@article{osti_1420916,
title = {CMS Readiness for Multi-Core Workload Scheduling},
author = {Perez-Calero Yzquierdo, A. and Balcas, J. and Hernandez, J. and Aftab Khan, F. and Letts, J. and Mason, D. and Verguilov, V.},
abstractNote = {In the present run of the LHC, CMS data reconstruction and simulation algorithms benefit greatly from being executed as multiple threads running on several processor cores. The complexity of the Run 2 events requires parallelization of the code to reduce the memory-per- core footprint constraining serial execution programs, thus optimizing the exploitation of present multi-core processor architectures. The allocation of computing resources for multi-core tasks, however, becomes a complex problem in itself. The CMS workload submission infrastructure employs multi-slot partitionable pilots, built on HTCondor and GlideinWMS native features, to enable scheduling of single and multi-core jobs simultaneously. This provides a solution for the scheduling problem in a uniform way across grid sites running a diversity of gateways to compute resources and batch system technologies. This paper presents this strategy and the tools on which it has been implemented. The experience of managing multi-core resources at the Tier-0 and Tier-1 sites during 2015, along with the deployment phase to Tier-2 sites during early 2016 is reported. The process of performance monitoring and optimization to achieve efficient and flexible use of the resources is also described.},
doi = {10.1088/1742-6596/898/5/052030},
journal = {J.Phys.Conf.Ser.},
number = 5,
volume = 898,
place = {United States},
year = {Wed Nov 22 00:00:00 EST 2017},
month = {Wed Nov 22 00:00:00 EST 2017}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: