Experience with Rucio in the wider HEP community

Conference · Fri Jan 01 00:00:00 EST 2021 · EPJ Web Conf.

DOI:https://doi.org/10.1051/epjconf/202125102030· OSTI ID:1839557

Barisits, Martin  ^[1]; Beermann, Thomas  ^[2]; Cameron, David  ^[3]; Clark, James Alexander  ^[4]; Di Maria, Riccardo  ^[1]; Fronzé, Gabriele Gaetano  ^[5]; Johnson, Ian ^[6]; Lassnig, Mario  ^[1]; Serfon, Cédric  ^[7]; Vaandering, Eric W.  ^[8]

---

1. CERN
2. Wuppertal U.
3. Oslo U.
4. Caltech; Georgia Tech
5. INFN, Turin
6. Rutherford
7. Brookhaven
8. Fermilab

Managing the data of scientific projects is an increasingly complicated challenge, which was historically met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years, the scientific data management system Rucio has evolved into a successful open-source project that is now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects and is offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio, as well as contributions to the project, by ATLAS, Belle II, CMS, ESCAPE, IGWN, LDMX, Folding@Home, and the UK’s Science and Technology Facilities Council (STFC).

• Research Organization: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States); Brookhaven National Lab. (BNL), Upton, NY (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1839557
• Report Number(s): FERMILAB-CONF-21-753-SCD; oai:inspirehep.net:1911840
• Journal Information: EPJ Web Conf., Vol. 251
• Country of Publication: United States
• Language: English