Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support

Conference · 01 January 2020 · EPJ Web Conf.

DOI:https://doi.org/10.1051/epjconf/202024503023· OSTI ID:1842719

Dost, Jeffrey ^[1]; Mascheroni, Marco ^[1]; Andreeva, Julia ^[2]; Anisenkov, Alexey ^[3]; Box, Dennis ^[4]; Di Girolamo, Alessandro ^[2]; Haleem, Saqib ^[5]; Kizinevič, Edita ^[6]; Majewski, Krista ^[4]; Letts, James ^[1]; Pardavila, Lorena Lobato ^[4]; Coimbra, Bruno Moreira ^[4]; Yzquierdo, Antonio Pérez-Calero ^[7]; Mambelli, Marco ^[4]; Paparrigopoulos, Panos ^[2]; Zvada, Marian ^[8]

---

1. UC, San Diego
2. CERN
3. Novosibirsk State U.; Novosibirsk, IYF
4. Fermilab
5. NCP, Islamabad
6. Vilnius U.
7. Madrid, CIEMAT; PIC, Bellaterra
8. Nebraska U.

GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.

• Research Organization: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1842719
• Report Number(s): FERMILAB-CONF-20-765-OCIO-SCD; oai:inspirehep.net:1831515
• Journal Information: EPJ Web Conf., Vol. 245
• Country of Publication: United States
• Language: English