Grid site availability evaluation and monitoring at CMS

Lyons, Gaston; Maciulaitis, Rokas; Bagliesi, Giuseppe; Lammel, Stephan; Sciaba, Andrea

doi:10.1088/1742-6596/898/9/092014

Title: Grid site availability evaluation and monitoring at CMS

Full Record
Other Related Research

Abstract

The Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) uses distributed grid computing to store, process, and analyse the vast quantity of scientific data recorded every year. The computing resources are grouped into sites and organized in a tiered structure. Each site provides computing and storage to the CMS computing grid. Over a hundred sites worldwide contribute with resources from hundred to well over ten thousand computing cores and storage from tens of TBytes to tens of PBytes. In such a large computing setup scheduled and unscheduled outages occur continually and are not allowed to significantly impact data handling, processing, and analysis. Unscheduled capacity and performance reductions need to be detected promptly and corrected. CMS developed a sophisticated site evaluation and monitoring system for Run 1 of the LHC based on tools of the Worldwide LHC Computing Grid. For Run 2 of the LHC the site evaluation and monitoring system is being overhauled to enable faster detection/reaction to failures and a more dynamic handling of computing resources. Furthermore, enhancements to better distinguish site from central service issues and to make evaluations more transparent and informative to site support staff are planned.

Authors:

Lyons, Gaston ^[1]; Maciulaitis, Rokas ^[2]; Bagliesi, Giuseppe ^[3];

^[1]; Sciaba, Andrea ^[4]

Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Vilnius Univ., Vilnius (Lithuania)
Univ. di Pisa & INFN, Pisa (Italy)
European Organization for Nuclear Research (CERN), Geneva (Switzerland)

Publication Date:: Sun Oct 01 00:00:00 EDT 2017

Research Org.:: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Sponsoring Org.:: USDOE Office of Science (SC), High Energy Physics (HEP)

OSTI Identifier:: 1415641

Report Number(s):: FERMILAB-CONF-16-752-CD
Journal ID: ISSN 1742-6588; 1638611; TRN: US1800845

Grant/Contract Number:: AC02-07CH11359

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Physics. Conference Series

Additional Journal Information:: Journal Volume: 898; Journal Issue: 9; Journal ID: ISSN 1742-6588

Publisher:: IOP Publishing

Country of Publication:: United States

Language:: English

Subject:: 43 PARTICLE ACCELERATORS

Citation Formats


                    Lyons, Gaston, Maciulaitis, Rokas, Bagliesi, Giuseppe, Lammel, Stephan, and Sciaba, Andrea. Grid site availability evaluation and monitoring at CMS.  United States: N. p., 2017. 
Web.  doi:10.1088/1742-6596/898/9/092014.

Copy to clipboard


                    Lyons, Gaston, Maciulaitis, Rokas, Bagliesi, Giuseppe, Lammel, Stephan, & Sciaba, Andrea. Grid site availability evaluation and monitoring at CMS.  United States.  https://doi.org/10.1088/1742-6596/898/9/092014

Copy to clipboard


                    Lyons, Gaston, Maciulaitis, Rokas, Bagliesi, Giuseppe, Lammel, Stephan, and Sciaba, Andrea. Sun .  
"Grid site availability evaluation and monitoring at CMS".  United States.  https://doi.org/10.1088/1742-6596/898/9/092014.  https://www.osti.gov/servlets/purl/1415641.

Copy to clipboard


                    
@article{osti_1415641,

  title        = {Grid site availability evaluation and monitoring at CMS},

  author       = {Lyons, Gaston and Maciulaitis, Rokas and Bagliesi, Giuseppe and Lammel, Stephan and Sciaba, Andrea},

  abstractNote = {The Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) uses distributed grid computing to store, process, and analyse the vast quantity of scientific data recorded every year. The computing resources are grouped into sites and organized in a tiered structure. Each site provides computing and storage to the CMS computing grid. Over a hundred sites worldwide contribute with resources from hundred to well over ten thousand computing cores and storage from tens of TBytes to tens of PBytes. In such a large computing setup scheduled and unscheduled outages occur continually and are not allowed to significantly impact data handling, processing, and analysis. Unscheduled capacity and performance reductions need to be detected promptly and corrected. CMS developed a sophisticated site evaluation and monitoring system for Run 1 of the LHC based on tools of the Worldwide LHC Computing Grid. For Run 2 of the LHC the site evaluation and monitoring system is being overhauled to enable faster detection/reaction to failures and a more dynamic handling of computing resources. Furthermore, enhancements to better distinguish site from central service issues and to make evaluations more transparent and informative to site support staff are planned.},

  doi          = {10.1088/1742-6596/898/9/092014},

  journal      = {Journal of Physics. Conference Series},

  number       = 9,

  volume       = 898,

  place        = {United States},

  year         = {Sun Oct 01 00:00:00 EDT 2017},

  month        = {Sun Oct 01 00:00:00 EDT 2017}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1088/1742-6596/898/9/092014

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

Experience with dynamic resource provisioning of the CMS online cluster using a cloud overlay

Journal Article Andre, Jean-Marc ; Behrens, Ulf ; Branson, James ; ... - EPJ Web of Conferences

The primary goal of the online cluster of the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) is to build event data from the detector and to select interesting collisions in the High Level Trigger (HLT) farm for offline storage. With more than 1500 nodes and a capacity of about 850 kHEPSpecInt06, the HLT machines represent similar computing capacity of all the CMS Tier1 Grid sites together. Moreover, it is currently connected to the CERN IT datacenter via a dedicated 160 Gbps network connection and hence can access the remote EOS based storage with a high bandwidth.more »« less
https://doi.org/10.1051/epjconf/201921407017

Full Text Available
CMS readiness for multi-core workload scheduling

Journal Article Yzquierdo, A. Perez-Calero ; Balcas, J. ; Hernandez, J. ; ... - Journal of Physics. Conference Series

In the present run of the LHC, CMS data reconstruction and simulation algorithms benefit greatly from being executed as multiple threads running on several processor cores. The complexity of the Run 2 events requires parallelization of the code to reduce the memory-per- core footprint constraining serial execution programs, thus optimizing the exploitation of present multi-core processor architectures. The allocation of computing resources for multi-core tasks, however, becomes a complex problem in itself. The CMS workload submission infrastructure employs multi-slot partitionable pilots, built on HTCondor and GlideinWMS native features, to enable scheduling of single and multi-core jobs simultaneously. This provides amore »« less
https://doi.org/10.1088/1742-6596/898/5/052030

Full Text Available
Monitoring data transfer latency in CMS computing operations

Journal Article Bonacorsi, Daniele ; Diotalevi, Tommaso ; Magini, Nicolo ; ... - Journal of Physics. Conference Series

During the first LHC run, the CMS experiment collected tens of Petabytes of collision and simulated data, which need to be distributed among dozens of computing centres with low latency in order to make efficient use of the resources. While the desired level of throughput has been successfully achieved, it is still common to observe transfer workflows that cannot reach full completion in a timely manner due to a small fraction of stuck files which require operator intervention.For this reason, in 2012 the CMS transfer management system, PhEDEx, was instrumented with a monitoring system to measure file transfer latencies, andmore »« less
Cited by 2
https://doi.org/10.1088/1742-6596/664/3/032033

Full Text Available
Use of DAGMan in CRAB3 to improve the splitting of CMS user jobs

Journal Article Wolf, M. ; Mascheroni, M. ; Woodard, A. ; ... - Journal of Physics. Conference Series

CRAB3 is a workload management tool used by CMS physicists to analyze data acquired by the Compact Muon Solenoid (CMS) detector at the CERN Large Hadron Collider (LHC). Research in high energy physics often requires the analysis of large collections of files, referred to as datasets. The task is divided into jobs that are distributed among a large collection of worker nodes throughout the Worldwide LHC Computing Grid (WLCG). Splitting a large analysis task into optimally sized jobs is critical to efficient use of distributed computing resources. Jobs that are too big will have excessive runtimes and will not distributemore »« less
https://doi.org/10.1088/1742-6596/898/5/052035

Full Text Available
Pooling the resources of the CMS Tier-1 sites

Journal Article Apyan, A. ; Badillo, J. ; Cruz, J. Diaz ; ... - Journal of Physics. Conference Series

The CMS experiment at the LHC relies on 7 Tier-1 centres of the WLCG to perform the majority of its bulk processing activity, and to archive its data. During the first run of the LHC, these two functions were tightly coupled as each Tier-1 was constrained to process only the data archived on its hierarchical storage. This lack of flexibility in the assignment of processing workflows occasionally resulted in uneven resource utilisation and in an increased latency in the delivery of the results to the physics community.The long shutdown of the LHC in 2013-2014 was an opportunity to revisit thismore »« less
https://doi.org/10.1088/1742-6596/664/4/042056

Full Text Available

Similar Records