Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

CMS readiness for multi-core workload scheduling

Journal Article · · Journal of Physics. Conference Series
 [1];  [2];  [3];  [4];  [5];  [6];  [7]
  1. Pord d'Informacio Cientifica, Barcelona (Spain); Research Centre for Energy, Environment and Technology (CIEMAT), Madrid (Spain)
  2. California Inst. of Technology (CalTech), Pasadena, CA (United States)
  3. Research Centre for Energy, Environment and Technology (CIEMAT), Madrid (Spain)
  4. Quaid-I-Azam Univ., Islamabad (Pakistan)
  5. Univ. of California, San Diego, CA (United States)
  6. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  7. Bulgarian Academy of Sciences, Sofia (Bulgaria)
+ Show Author Affiliations
In the present run of the LHC, CMS data reconstruction and simulation algorithms benefit greatly from being executed as multiple threads running on several processor cores. The complexity of the Run 2 events requires parallelization of the code to reduce the memory-per- core footprint constraining serial execution programs, thus optimizing the exploitation of present multi-core processor architectures. The allocation of computing resources for multi-core tasks, however, becomes a complex problem in itself. The CMS workload submission infrastructure employs multi-slot partitionable pilots, built on HTCondor and GlideinWMS native features, to enable scheduling of single and multi-core jobs simultaneously. This provides a solution for the scheduling problem in a uniform way across grid sites running a diversity of gateways to compute resources and batch system technologies. This paper presents this strategy and the tools on which it has been implemented. The experience of managing multi-core resources at the Tier-0 and Tier-1 sites during 2015, along with the deployment phase to Tier-2 sites during early 2016 is reported. The process of performance monitoring and optimization to achieve efficient and flexible use of the resources is also described.
Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1420916
Report Number(s):
FERMILAB-CONF--16-755-CD; 1638487
Journal Information:
Journal of Physics. Conference Series, Journal Name: Journal of Physics. Conference Series Journal Issue: 5 Vol. 898; ISSN 1742-6588
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United States
Language:
English

References (1)

Using the CMS High Level Trigger as a Cloud Resource journal June 2014

Cited By (1)

Evolution of the CMS Global Submission Infrastructure for the HL-LHC Era journal January 2020

Figures / Tables (7)

Figure 1(p. 3)figure Figure 1
Figure 2(p. 4)figure Figure 2
Figure 3(p. 5)figure Figure 3
Table 1(p. 5)table Table 1
Figure 4(p. 6)figure Figure 4
Figure 5(p. 6)figure Figure 5
Figure 6(p. 7)figure Figure 6

Similar Records

Improving the Scheduling Efficiency of a Global Multi-Core HTCondor Pool in CMS
Conference · Mon Dec 31 23:00:00 EST 2018 · EPJ Web Conf. · OSTI ID:1854894
Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits
Journal Article · Tue Nov 21 19:00:00 EST 2017 · Journal of Physics. Conference Series · OSTI ID:1420915
Multi-core processing and scheduling performance in CMS
Conference · Sat Dec 31 23:00:00 EST 2011 · J.Phys.Conf.Ser. · OSTI ID:1405107

Related Subjects

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS
97 MATHEMATICS AND COMPUTING