CMS distributed data analysis with CRAB3

Journal Article · Wed Dec 23 00:00:00 EST 2015 · Journal of Physics. Conference Series

DOI:https://doi.org/10.1088/1742-6596/664/6/062038· OSTI ID:1250780

Mascheroni, M. ^[1]; Balcas, J. ^[2]; Belforte, S. ^[3]; Bockelman, B. P. ^[4]; Hernandez, J. M. ^[5]; Ciangottini, D. ^[6]; Konstantinov, P. B. ^[7]; Silva, J. M. D. ^[8]; Ali, M. A. B. M. ^[9]; Melo, A. M. ^[10]; Riahi, H. ^[11]; Tanasijczuk, A. J. ^[12]; Yusli, M. N. B. ^[9]; Wolf, M. ^[13]; Woodard, A. E. ^[13]; Vaandering, E. ^[14]

---

1. Univ. e INFN, Sezione di Milano-Bicocca (Rome)
2. Vilnius Univ., Vilnius (Lithuania)
3. Univ. e INFN, Sezione di Trieste (Italy)
4. Univ. of Nebraska-Lincoln, Lincoln, NE (United States)
5. CIEMAT, Madrid (Spain)
6. Univ. e INFN, Sezione di Perugia (Italy)
7. Bulgarian Academy of Sciences, Sofia (Bulgaria)
8. Univ. Estadual Paulista (Brazil)
9. Univ. of Malaya (Malaysia)
10. Vanderbilt Univ., Nashville, TN (United States)
11. European Organization for Nuclear Research (CERN), Geneva (Switzerland)
12. Univ. of California, San Diego, CA (United States)
13. Univ. of Notre Dame, Notre Dame, IN (United States)
14. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. Furthermore, the new system improves the robustness, scalability and sustainability of the service.Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.

• Research Organization: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• Grant/Contract Number: AC02-07CH11359
• OSTI ID: 1250780
• Report Number(s): FERMILAB-CONF-15-606-CD; 1413959
• Journal Information: Journal of Physics. Conference Series, Vol. 664, Issue 6; Conference: 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa (Japan), 13-17 Apr 2015; ISSN 1742-6588
• Publisher: IOP Publishing
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING