skip to main content

DOE PAGESDOE PAGES

Title: CMS distributed data analysis with CRAB3

The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. Furthermore, the new system improves the robustness, scalability and sustainability of the service.Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.
Authors:
 [1] ;  [2] ;  [3] ;  [4] ;  [5] ;  [6] ;  [7] ;  [8] ;  [9] ;  [10] ;  [11] ;  [12] ;  [9] ;  [13] ;  [13] ;  [14]
  1. Univ. e INFN, Sezione di Milano-Bicocca (Rome)
  2. Vilnius Univ., Vilnius (Lithuania)
  3. Univ. e INFN, Sezione di Trieste (Italy)
  4. Univ. of Nebraska-Lincoln, Lincoln, NE (United States)
  5. CIEMAT, Madrid (Spain)
  6. Univ. e INFN, Sezione di Perugia (Italy)
  7. Bulgarian Academy of Sciences, Sofia (Bulgaria)
  8. Univ. Estadual Paulista (Brazil)
  9. Univ. of Malaya (Malaysia)
  10. Vanderbilt Univ., Nashville, TN (United States)
  11. European Organization for Nuclear Research (CERN), Geneva (Switzerland)
  12. Univ. of California, San Diego, CA (United States)
  13. Univ. of Notre Dame, Notre Dame, IN (United States)
  14. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Publication Date:
OSTI Identifier:
1250780
Report Number(s):
FERMILAB-CONF--15-606-CD
Journal ID: ISSN 1742-6588; 1413959
Grant/Contract Number:
AC02-07CH11359
Type:
Accepted Manuscript
Journal Name:
Journal of Physics. Conference Series
Additional Journal Information:
Journal Volume: 664; Journal Issue: 6; Conference: 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa (Japan), 13-17 Apr 2015; Journal ID: ISSN 1742-6588
Publisher:
IOP Publishing
Research Org:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Org:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING