CMS distributed computing workflow experience
The vast majority of the CMS Computing capacity, which is organized in a tiered hierarchy, is located away from CERN. The 7 Tier-1 sites archive the LHC proton-proton collision data that is initially processed at CERN. These sites provide access to all recorded and simulated data for the Tier-2 sites, via wide-area network (WAN) transfers. All central data processing workflows are executed at the Tier-1 level, which contain re-reconstruction and skimming workflows of collision data as well as reprocessing of simulated data to adapt to changing detector conditions. This paper describes the operation of the CMS processing infrastructure at the Tier-1 level. The Tier-1 workflows are described in detail. The operational optimization of resource usage is described. In particular, the variation of different workflows during the data taking period of 2010, their efficiencies and latencies as well as their impact on the delivery of physics results is discussed and lessons are drawn from this experience. The simulation of proton-proton collisions for the CMS experiment is primarily carried out at the second tier of the CMS computing infrastructure. Half of the Tier-2 sites of CMS are reserved for central Monte Carlo (MC) production while the other half is available for user analysis. This paper summarizes the large throughput of the MC production operation during the data taking period of 2010 and discusses the latencies and efficiencies of the various types of MC production workflows. We present the operational procedures to optimize the usage of available resources and we the operational model of CMS for including opportunistic resources, such as the larger Tier-3 sites, into the central production operation.
- Research Organization:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
- DOE Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1433875
- Report Number(s):
- FERMILAB-CONF-11-865-CD; 1111392
- Conference Information:
- Journal Name: J.Phys.Conf.Ser. Journal Volume: 331
- Country of Publication:
- United States
- Language:
- English
Similar Records
Opportunistic Resource Usage in CMS
The diverse use of clouds by CMS
Monitoring data transfer latency in CMS computing operations
Conference
·
Tue Dec 31 23:00:00 EST 2013
· J.Phys.Conf.Ser.
·
OSTI ID:1296593
The diverse use of clouds by CMS
Journal Article
·
Tue Dec 22 19:00:00 EST 2015
· Journal of Physics. Conference Series
·
OSTI ID:1250787
Monitoring data transfer latency in CMS computing operations
Journal Article
·
Tue Dec 22 19:00:00 EST 2015
· Journal of Physics. Conference Series
·
OSTI ID:1346387