Evolution of the pilot infrastructure of CMS: towards a single glideinWMS pool

Conference · Tue Dec 31 23:00:00 EST 2013 · J.Phys.Conf.Ser.

DOI:https://doi.org/10.1088/1742-6596/513/3/032041· OSTI ID:1295710

Belforte, S. ^[1]; Gutsche, O. ^[2]; Letts, J. ^[3]; Majewski, K. ^[2]; McCrea, A. ^[3]; Sfiligoi, I. ^[3]

---

1. Trieste U.
2. Fermilab
3. San Diego U.

CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1295710
• Report Number(s): FERMILAB-CONF-13-493-CD; 1302010
• Journal Information: J.Phys.Conf.Ser., Journal Name: J.Phys.Conf.Ser. Vol. 513
• Country of Publication: United States
• Language: English