skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Distributed analysis with CRAB: The client-server architecture evolution and commissioning

Abstract

CRAB (CMS Remote Analysis Builder) is the tool used by CMS to enable running physics analysis in a transparent manner over data distributed across many sites. It abstracts out the interaction with the underlying batch farms, grid infrastructure and CMS workload management tools, such that it is easily usable by non-experts. CRAB can be used as a direct interface to the computing system or can delegate the user task to a server. Major efforts have been dedicated to the client-server system development, allowing the user to deal only with a simple and intuitive interface and to delegate all the work to a server. The server takes care of handling the users jobs during the whole lifetime of the users task. In particular, it takes care of the data and resources discovery, process tracking and output handling. It also provides services such as automatic resubmission in case of failures, notification to the user of the task status, and automatic blacklisting of sites showing evident problems beyond what is provided by existing grid infrastructure. The CRAB Server architecture and its deployment will be presented, as well as the current status and future development. In addition the experience in using the system formore » initial detector commissioning activities and data analysis will be summarized.« less

Authors:
; ; ; ; ; ; ; ;
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
984643
Report Number(s):
FERMILAB-CONF-08-691-CD
TRN: US201016%%1409
DOE Contract Number:  
AC02-07CH11359
Resource Type:
Conference
Journal Name:
PoS ACAT08:029,2008
Additional Journal Information:
Conference: Prepared for 12th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2008), Erice, Sicily, Italy, 3-7 Nov 2008
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; COMPUTER ARCHITECTURE; COMMISSIONING; DATA ANALYSIS; LIFETIME; MANAGEMENT; PHYSICS; Computing

Citation Formats

Codispoti, G, /INFN, Bologna /Bologna U., Cinquilli, M, /INFN, Perugia, Fanfani, A, /Bologna U., Fanzago, F, /CERN /INFN, CNAF, Farina, F, /CERN /INFN, Milan Bicocca, Lacaprara, S, /INFN, Legnaro, Miccio, V, /CERN /INFN, CNAF, Spiga, D, /CERN /INFN, Perugia /Perugia U., Vaandering, E, and /Fermilab. Distributed analysis with CRAB: The client-server architecture evolution and commissioning. United States: N. p., 2008. Web.
Codispoti, G, /INFN, Bologna /Bologna U., Cinquilli, M, /INFN, Perugia, Fanfani, A, /Bologna U., Fanzago, F, /CERN /INFN, CNAF, Farina, F, /CERN /INFN, Milan Bicocca, Lacaprara, S, /INFN, Legnaro, Miccio, V, /CERN /INFN, CNAF, Spiga, D, /CERN /INFN, Perugia /Perugia U., Vaandering, E, & /Fermilab. Distributed analysis with CRAB: The client-server architecture evolution and commissioning. United States.
Codispoti, G, /INFN, Bologna /Bologna U., Cinquilli, M, /INFN, Perugia, Fanfani, A, /Bologna U., Fanzago, F, /CERN /INFN, CNAF, Farina, F, /CERN /INFN, Milan Bicocca, Lacaprara, S, /INFN, Legnaro, Miccio, V, /CERN /INFN, CNAF, Spiga, D, /CERN /INFN, Perugia /Perugia U., Vaandering, E, and /Fermilab. 2008. "Distributed analysis with CRAB: The client-server architecture evolution and commissioning". United States. https://www.osti.gov/servlets/purl/984643.
@article{osti_984643,
title = {Distributed analysis with CRAB: The client-server architecture evolution and commissioning},
author = {Codispoti, G and /INFN, Bologna /Bologna U. and Cinquilli, M and /INFN, Perugia and Fanfani, A and /Bologna U. and Fanzago, F and /CERN /INFN, CNAF and Farina, F and /CERN /INFN, Milan Bicocca and Lacaprara, S and /INFN, Legnaro and Miccio, V and /CERN /INFN, CNAF and Spiga, D and /CERN /INFN, Perugia /Perugia U. and Vaandering, E and /Fermilab},
abstractNote = {CRAB (CMS Remote Analysis Builder) is the tool used by CMS to enable running physics analysis in a transparent manner over data distributed across many sites. It abstracts out the interaction with the underlying batch farms, grid infrastructure and CMS workload management tools, such that it is easily usable by non-experts. CRAB can be used as a direct interface to the computing system or can delegate the user task to a server. Major efforts have been dedicated to the client-server system development, allowing the user to deal only with a simple and intuitive interface and to delegate all the work to a server. The server takes care of handling the users jobs during the whole lifetime of the users task. In particular, it takes care of the data and resources discovery, process tracking and output handling. It also provides services such as automatic resubmission in case of failures, notification to the user of the task status, and automatic blacklisting of sites showing evident problems beyond what is provided by existing grid infrastructure. The CRAB Server architecture and its deployment will be presented, as well as the current status and future development. In addition the experience in using the system for initial detector commissioning activities and data analysis will be summarized.},
doi = {},
url = {https://www.osti.gov/biblio/984643}, journal = {PoS ACAT08:029,2008},
number = ,
volume = ,
place = {United States},
year = {Tue Jan 01 00:00:00 EST 2008},
month = {Tue Jan 01 00:00:00 EST 2008}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: