skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Connecting Restricted, High-Availability, or Low-Latency Resources to a Seamless Global Pool for CMS

Journal Article · · Journal of Physics. Conference Series
 [1]; ORCiD logo [2]; ORCiD logo [3];  [4]; ORCiD logo [3];  [5];  [3]; ORCiD logo [6]; ORCiD logo [3];  [7]; ORCiD logo [8];  [3]; ORCiD logo [9];  [10];  [3];  [11]
  1. California Institute of Technology (CalTech), Pasadena, CA (United States)
  2. Univ. of Nebraska, Lincoln, NE (United States)
  3. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  4. Univ. of Notre Dame, IN (United States)
  5. Quaid-I-Azam University, Islamabad (Pakistan)
  6. Univ. of California, San Diego, CA (United States)
  7. Univ. of Wisconsin, Madison, WI (United States)
  8. Universidade Estadual Paulista, São Paolo (Brazil)
  9. Port d'Informació Científica, Barcelona (Spain); Research Centre for Energy, Environment and Technology (CIEMAT), Madrid (Spain)
  10. Brown Univ., Providence, RI (United States)
  11. Bulgarian Academy of Sciences, Sofia (Bulgaria)

The connection of diverse and sometimes non-Grid enabled resource types to the CMS Global Pool, which is based on HTCondor and glideinWMS, has been a major goal of CMS. These resources range in type from a high-availability, low latency facility at CERN for urgent calibration studies, called the CAF, to a local user facility at the Fermilab LPC, allocation-based computing resources at NERSC and SDSC, opportunistic resources provided through the Open Science Grid, commercial clouds, and others, as well as access to opportunistic cycles on the CMS High Level Trigger farm. In addition, we have provided the capability to give priority to local users of beyond WLCG pledged resources at CMS sites. Many of the solutions employed to bring these diverse resource types into the Global Pool have common elements, while some are very specific to a particular project. This paper details some of the strategies and solutions used to access these resources through the Global Pool in a seamless manner.

Research Organization:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
CMS Collaboration
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1831937
Report Number(s):
FERMILAB-PUB-17-721-CMS; oai:inspirehep.net:1638160; TRN: US2216680
Journal Information:
Journal of Physics. Conference Series, Vol. 898, Issue 5; ISSN 1742-6588
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United States
Language:
English

References (4)

Campus Grids: Bringing Additional Computational Resources to HEP Researchers journal December 2012
Distributed computing in practice: the Condor experience
  • Thain, Douglas; Tannenbaum, Todd; Livny, Miron
  • Concurrency and Computation: Practice and Experience, Vol. 17, Issue 2-4, p. 323-356 https://doi.org/10.1002/cpe.938
journal January 2005
The OSG open facility: A sharing ecosystem journal December 2015
Scaling the CERN OpenStack cloud journal December 2015

Similar Records

Stability and scalability of the CMS Global Pool: Pushing HTCondor and glideinWMS to new limits
Journal Article · Wed Nov 22 00:00:00 EST 2017 · Journal of Physics. Conference Series · OSTI ID:1831937

Large scale and low latency analysis facilities for the CMS experiment: Development and operational aspects
Conference · Sat Jan 01 00:00:00 EST 2011 · J.Phys.Conf.Ser. · OSTI ID:1831937

Pushing HTCondor and glideinWMS to 200K+ Jobs in a Global Pool for CMS before Run 2
Conference · Wed Dec 23 00:00:00 EST 2015 · J.Phys.Conf.Ser. · OSTI ID:1831937