A New Era for Central Processing and Production in CMS
- Fermilab
- INFN, Pisa
- Rutherford
- MIT
The goal for CMS computing is to maximise the throughput of simulated event generation while also processing event data generated by the detector as quickly and reliably as possible. To maintain this achievement as the quantity of events increases CMS computing has migrated at the Tier 1 level from its old production framework, ProdAgent, to a new one, WMAgent. The WMAgent framework offers improved processing efficiency and increased resource usage as well as a reduction in operational manpower. In addition to the challenges encountered during the design of the WMAgent framework, several operational issues have arisen during its commissioning. The largest operational challenges were in the usage and monitoring of resources, mainly a result of a change in the way work is allocated. Instead of work being assigned to operators, all work is centrally injected and managed in the Request Manager system and the task of the operators has changed from running individual workflows to monitoring the global workload. In this report we present how we tackled some of the operational challenges, and how we benefitted from the lessons learned in the commissioning of the WMAgent framework at the Tier 2 level in late 2011. As case studies, we will show how the WMAgent system performed during some of the large data reprocessing and Monte Carlo simulation campaigns.
- Research Organization:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- Contributing Organization:
- CMS
- DOE Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1419282
- Report Number(s):
- FERMILAB-CONF-12-310-CD; 1124264
- Journal Information:
- J.Phys.Conf.Ser., Vol. 396; Conference: 19th International Conference on Computing in High Energy and Nuclear Physics, New York, USA, 05/21-05/25/2012
- Country of Publication:
- United States
- Language:
- English
Similar Records
Multi-core processing and scheduling performance in CMS
A gLite FTS based solution for managing user output in CMS