Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: Integration of Rucio Metadata in Belle II

Journal Article · · EPJ Web of Conferences (Online)
 [1];  [2];  [1];  [1];  [3];  [1];  [1];  [4];  [4]
  1. Brookhaven National Laboratory (BNL), Upton, NY (United States)
  2. Univ. of Mississippi, Oxford, MS (United States)
  3. Deutsches Elektronen-Synchrotron (DESY), Hamburg (Germany)
  4. High Energy Accelerator Research Organization (KEK), Tsukuba (Japan); Graduate University for Advanced Studies, Tsukuba (Japan)
+ Show Author Affiliations

Rucio is a Data Management software that has become a de-facto standard in the HEP community and beyond. It allows the management of large volumes of data over their full lifecycle. The Belle II experiment located at KEK (Japan) recently moved to Rucio to manage its data over the coming decade (O(10) PB/year). In addition to its Data Management functionalities, Rucio also provides support for storing generic metadata. Rucio metadata already provides accurate accounting of the data stored all over the sites serving Belle II. Annotating files with generic metadata opens up possibilities for finer-grained metadata query support. We will first introduce some of the new developments aimed at providing good performance that were done to cover Belle II use-cases like bulk insert methods, metadata inheritance, etc. We will then describe the various tests performed to validate Rucio generic metadata at Belle II scale (O(100M) files), detailing the import and performance tests that were made.

Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Grant/Contract Number:
SC0012704
OSTI ID:
2448340
Report Number(s):
BNL--226148-2024-JAAM
Journal Information:
EPJ Web of Conferences (Online), Journal Name: EPJ Web of Conferences (Online) Vol. 295; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (9)

SuperKEKB collider
  • Akai, Kazunori; Furukawa, Kazuro; Koiso, Haruyo
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 907 https://doi.org/10.1016/j.nima.2018.08.017
journal November 2018
The DIRAC interware: current, upcoming and planned capabilities and technologies journal January 2020
The Rucio File Catalog in DIRAC implemented for Belle II journal January 2021
MetaCat - metadata catalog for data management systems journal January 2021
Integration of Rucio in Belle II journal January 2021
DIRAC File Replica and Metadata Catalog journal December 2012
Computing at the Belle II experiment journal December 2015
Improvement of AMGA Python Client Library for Belle II Experiment journal December 2015
Belle II production system journal December 2015

Similar Records

Related Subjects

97 MATHEMATICS AND COMPUTING