Using the GlideinWMS System as a Common Resource Provisioning Layer in CMS

Conference · Wed Dec 23 00:00:00 EST 2015 · J.Phys.Conf.Ser.

DOI:https://doi.org/10.1088/1742-6596/664/6/062031· OSTI ID:1247509

Balcas, J. ^[1]; Belforte, S. ^[2]; Bockelman, B. ^[3]; Colling, D. ^[4]; Gutsche, O. ^[5]; Hufnagel, D. ^[5]; Khan, F. ^[6]; Larson, K. ^[5]; Letts, J. ^[7]; Mascheroni, M. ^[8]; Mason, D. ^[5]; McCrea, A. ^[7]; Piperov, S. ^[9]; Saiz-Santos, M. ^[7]; Sfiligoi, I. ^[7]; Tanasijczuk, A. ^[7]; Wissing, C. ^[10]

---

1. Vilnius U.
2. Trieste U.
3. Nebraska U.
4. Imperial Coll., London
5. Fermilab
6. Quaid-i-Azam U.
7. UC, San Diego
8. Milan Bicocca U.
9. Brown U.
10. DESY

CMS will require access to more than 125k processor cores for the beginning of Run 2 in 2015 to carry out its ambitious physics program with more and higher complexity events. During Run1 these resources were predominantly provided by a mix of grid sites and local batch resources. During the long shut down cloud infrastructures, diverse opportunistic resources and HPC supercomputing centers were made available to CMS, which further complicated the operations of the submission infrastructure. In this presentation we will discuss the CMS effort to adopt and deploy the glideinWMS system as a common resource provisioning layer to grid, cloud, local batch, and opportunistic resources and sites. We will address the challenges associated with integrating the various types of resources, the efficiency gains and simplifications associated with using a common resource provisioning layer, and discuss the solutions found. We will finish with an outlook of future plans for how CMS is moving forward on resource provisioning for more heterogenous architectures and services.

• Research Organization: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1247509
• Report Number(s): FERMILAB-CONF-15-603-CD; 1413952
• Journal Information: J.Phys.Conf.Ser., Vol. 664, Issue 6; Conference: 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa, Japan, 04/13-04/17/2015
• Country of Publication: United States
• Language: English