skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A New Era for Central Processing and Production in CMS

Abstract

The goal for CMS computing is to maximise the throughput of simulated event generation while also processing event data generated by the detector as quickly and reliably as possible. To maintain this achievement as the quantity of events increases CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in operational manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we willmore » show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.« less

Authors:
;  [1];  [1];  [1];  [2];  [3];  [4];  [4]
  1. Fermilab
  2. INFN, Pisa
  3. Rutherford
  4. MIT
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Contributing Org.:
CMS
OSTI Identifier:
1419282
Report Number(s):
FERMILAB-CONF-12-310-CD
1124264
DOE Contract Number:  
AC02-07CH11359
Resource Type:
Conference
Journal Name:
J.Phys.Conf.Ser.
Additional Journal Information:
Journal Volume: 396; Conference: 19th International Conference on Computing in High Energy and Nuclear Physics, New York, USA, 05/21-05/25/2012
Country of Publication:
United States
Language:
English
Subject:
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Citation Formats

Fajardo, E., Gutsche, O., Foulkes, S., Linacre, J., Spinoso, V., Lahiff, A., Gomez-Ceballos, G., and Klute, M. A New Era for Central Processing and Production in CMS. United States: N. p., 2012. Web. doi:10.1088/1742-6596/396/4/042018.
Fajardo, E., Gutsche, O., Foulkes, S., Linacre, J., Spinoso, V., Lahiff, A., Gomez-Ceballos, G., & Klute, M. A New Era for Central Processing and Production in CMS. United States. doi:10.1088/1742-6596/396/4/042018.
Fajardo, E., Gutsche, O., Foulkes, S., Linacre, J., Spinoso, V., Lahiff, A., Gomez-Ceballos, G., and Klute, M. Wed . "A New Era for Central Processing and Production in CMS". United States. doi:10.1088/1742-6596/396/4/042018. https://www.osti.gov/servlets/purl/1419282.
@article{osti_1419282,
title = {A New Era for Central Processing and Production in CMS},
author = {Fajardo, E. and Gutsche, O. and Foulkes, S. and Linacre, J. and Spinoso, V. and Lahiff, A. and Gomez-Ceballos, G. and Klute, M.},
abstractNote = {The goal for CMS computing is to maximise the throughput of simulated event generation while also processing event data generated by the detector as quickly and reliably as possible. To maintain this achievement as the quantity of events increases CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in operational manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.},
doi = {10.1088/1742-6596/396/4/042018},
journal = {J.Phys.Conf.Ser.},
number = ,
volume = 396,
place = {United States},
year = {2012},
month = {6}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: