CMS distributed data analysis with CRAB3

Mascheroni, M.; Balcas, J.; Belforte, S.; Bockelman, B. P.; Hernandez, J. M.; Ciangottini, D.; Konstantinov, P. B.; Silva, J. M. D.; Ali, M. A. B. M.; Melo, A. M.; Riahi, H.; Tanasijczuk, A. J.; Yusli, M. N. B.; Wolf, M.; Woodard, A. E.; Vaandering, E.

doi:10.1088/1742-6596/664/6/062038

Title: CMS distributed data analysis with CRAB3

Full Record
Other Related Research

Abstract

The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. Furthermore, the new system improves the robustness, scalability and sustainability of the service.Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.

Authors:

Mascheroni, M. ^[1]; Balcas, J. ^[2]; Belforte, S. ^[3]; Bockelman, B. P. ^[4]; Hernandez, J. M. ^[5]; Ciangottini, D. ^[6]; Konstantinov, P. B. ^[7]; Silva, J. M. D. ^[8]; Ali, M. A. B. M. ^[9]; Melo, A. M. ^[10]; Riahi, H. ^[11]; Tanasijczuk, A. J. ^[12]; Yusli, M. N. B. ^[9]; Wolf, M. ^[13]; Woodard, A. E. ^[13]; Vaandering, E. ^[14]

Univ. e INFN, Sezione di Milano-Bicocca (Rome)
Vilnius Univ., Vilnius (Lithuania)
Univ. e INFN, Sezione di Trieste (Italy)
Univ. of Nebraska-Lincoln, Lincoln, NE (United States)
CIEMAT, Madrid (Spain)
Univ. e INFN, Sezione di Perugia (Italy)
Bulgarian Academy of Sciences, Sofia (Bulgaria)
Univ. Estadual Paulista (Brazil)
Univ. of Malaya (Malaysia)
Vanderbilt Univ., Nashville, TN (United States)
European Organization for Nuclear Research (CERN), Geneva (Switzerland)
Univ. of California, San Diego, CA (United States)
Univ. of Notre Dame, Notre Dame, IN (United States)
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Publication Date:: Wed Dec 23 00:00:00 EST 2015

Research Org.:: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Sponsoring Org.:: USDOE Office of Science (SC), High Energy Physics (HEP)

OSTI Identifier:: 1250780

Report Number(s):: FERMILAB-CONF-15-606-CD
Journal ID: ISSN 1742-6588; 1413959

Grant/Contract Number:: AC02-07CH11359

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Physics. Conference Series

Additional Journal Information:: Journal Volume: 664; Journal Issue: 6; Conference: 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa (Japan), 13-17 Apr 2015; Journal ID: ISSN 1742-6588

Publisher:: IOP Publishing

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Mascheroni, M., Balcas, J., Belforte, S., Bockelman, B. P., Hernandez, J. M., Ciangottini, D., Konstantinov, P. B., Silva, J. M. D., Ali, M. A. B. M., Melo, A. M., Riahi, H., Tanasijczuk, A. J., Yusli, M. N. B., Wolf, M., Woodard, A. E., and Vaandering, E. CMS distributed data analysis with CRAB3.  United States: N. p., 2015. 
Web.  doi:10.1088/1742-6596/664/6/062038.

Copy to clipboard


                    Mascheroni, M., Balcas, J., Belforte, S., Bockelman, B. P., Hernandez, J. M., Ciangottini, D., Konstantinov, P. B., Silva, J. M. D., Ali, M. A. B. M., Melo, A. M., Riahi, H., Tanasijczuk, A. J., Yusli, M. N. B., Wolf, M., Woodard, A. E., & Vaandering, E. CMS distributed data analysis with CRAB3.  United States.  https://doi.org/10.1088/1742-6596/664/6/062038

Copy to clipboard


                    Mascheroni, M., Balcas, J., Belforte, S., Bockelman, B. P., Hernandez, J. M., Ciangottini, D., Konstantinov, P. B., Silva, J. M. D., Ali, M. A. B. M., Melo, A. M., Riahi, H., Tanasijczuk, A. J., Yusli, M. N. B., Wolf, M., Woodard, A. E., and Vaandering, E. Wed .  
"CMS distributed data analysis with CRAB3".  United States.  https://doi.org/10.1088/1742-6596/664/6/062038.  https://www.osti.gov/servlets/purl/1250780.

Copy to clipboard


                    
@article{osti_1250780,

  title        = {CMS distributed data analysis with CRAB3},

  author       = {Mascheroni, M. and Balcas, J. and Belforte, S. and Bockelman, B. P. and Hernandez, J. M. and Ciangottini, D. and Konstantinov, P. B. and Silva, J. M. D. and Ali, M. A. B. M. and Melo, A. M. and Riahi, H. and Tanasijczuk, A. J. and Yusli, M. N. B. and Wolf, M. and Woodard, A. E. and Vaandering, E.},

  abstractNote = {The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. Furthermore, the new system improves the robustness, scalability and sustainability of the service.Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.},

  doi          = {10.1088/1742-6596/664/6/062038},

  journal      = {Journal of Physics. Conference Series},

  number       = 6,

  volume       = 664,

  place        = {United States},

  year         = {Wed Dec 23 00:00:00 EST 2015},

  month        = {Wed Dec 23 00:00:00 EST 2015}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1088/1742-6596/664/6/062038

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 6 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

A gLite FTS based solution for managing user output in CMS

Conference Cinquilli, M. ; Riahi, H. ; Spiga, D. ; ... - J.Phys.Conf.Ser.

The CMS distributed data analysis workflow assumes that jobs run in a different location from where their results are finally stored. Typically the user output must be transferred across the network from one site to another, possibly on a different continent or over links not necessarily validated for high bandwidth/high reliability transfer. This step is named stage-out and in CMS was originally implemented as a synchronous step of the analysis job execution. However, our experience showed the weakness of this approach both in terms of low total job execution efficiency and failure rates, wasting precious CPU resources. The nature ofmore »« less
https://doi.org/10.1088/1742-6596/396/3/032025

Full Text Available
Distributed analysis with CRAB: The client-server architecture evolution and commissioning

Conference Codispoti, G ; /INFN, Bologna /Bologna U. ; Cinquilli, M ; ... - PoS ACAT08:029,2008

CRAB (CMS Remote Analysis Builder) is the tool used by CMS to enable running physics analysis in a transparent manner over data distributed across many sites. It abstracts out the interaction with the underlying batch farms, grid infrastructure and CMS workload management tools, such that it is easily usable by non-experts. CRAB can be used as a direct interface to the computing system or can delegate the user task to a server. Major efforts have been dedicated to the client-server system development, allowing the user to deal only with a simple and intuitive interface and to delegate all the workmore »« less
Full Text Available
Langston University - High Energy Physics (LU-HEP)

Technical Report Snow, Dr., Joel

This final report is presented by Langston University (LU) for the project entitled "Langston University High Energy Physics" (LUHEP) under the direction of principal investigator (PI) and project director Professor Joel Snow. The project encompassed high energy physics research performed at hadron colliders. The PI is a collaborator on the DZero experiment at Fermi National Accelerator Laboratory in Batavia, IL, USA and the ATLAS experiment at CERN in Geneva, Switzerland and was during the entire project period from April 1, 1999 until May 14, 2012. Both experiments seek to understand the fundamental constituents of the physical universe and the forcesmore »« less
https://doi.org/10.2172/1048139

Full Text Available
CRAB3: Establishing a new generation of services for distributed analysis at CMS

Conference Cinquilli, M. ; Spiga, D. ; Grandi, C. ; ... - J.Phys.Conf.Ser.

In CMS Computing the highest priorities for analysis tools are the improvement of the end users ability to produce and publish reliable samples and analysis results as well as a transition to a sustainable development and operations model. To achieve these goals CMS decided to incorporate analysis processing into the same framework as data and simulation processing. This strategy foresees that all workload tools (TierO, Tier1, production, analysis) share a common core with long term maintainability as well as the standardization of the operator interfaces. The re-engineered analysis workload manager, called CRAB3, makes use of newer technologies, such as RESTFulmore »« less
https://doi.org/10.1088/1742-6596/396/3/032026

Full Text Available
Efficient monitoring of CRAB jobs at CMS

Journal Article Silva, J. M. D. ; Balcas, J. ; Belforte, S. ; ... - Journal of Physics. Conference Series

CRAB is a tool used for distributed analysis of CMS data. Users can submit sets of jobs with similar requirements (tasks) with a single request. CRAB uses a client-server architecture, where a lightweight client, a server, and ancillary services work together and are maintained by CMS operators at CERN. As with most complex software, good monitoring tools are crucial for efficient use and longterm maintainability. This work gives an overview of the monitoring tools developed to ensure the CRAB server and infrastructure are functional, help operators debug user problems, and minimize overhead and operating cost. This work also illustrates themore »« less
https://doi.org/10.1088/1742-6596/898/9/092036

Full Text Available

Similar Records