Experience with dynamic resource provisioning of the CMS online cluster using a cloud overlay
Journal Article
·
· EPJ Web of Conferences
more »
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Deutsches Elektronen-Synchrotron (DESY), Hamburg (Germany)
- Univ. of California, San Diego, CA (United States)
- European Organization for Nuclear Research (CERN), Geneva (Switzerland); Karlsruhe Inst. of Technology (KIT), Karlsruhe (Germany)
- European Organization for Nuclear Research (CERN), Geneva (Switzerland)
- Massachusetts Inst. of Technology (MIT), Cambridge, MA (United States)
- Univ. of California, Los Angeles, CA (United States)
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States); Vilnius Univ., Vilnius (Lithuania)
- National Technical Univ. of Athens, Athens (Greece)
- Rice Univ., Houston, TX (United States)
- European Organization for Nuclear Research (CERN), Geneva (Switzerland); Vilnius Univ., Vilnius (Lithuania)
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States); European Organization for Nuclear Research (CERN), Geneva (Switzerland)
The primary goal of the online cluster of the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) is to build event data from the detector and to select interesting collisions in the High Level Trigger (HLT) farm for offline storage. With more than 1500 nodes and a capacity of about 850 kHEPSpecInt06, the HLT machines represent similar computing capacity of all the CMS Tier1 Grid sites together. Moreover, it is currently connected to the CERN IT datacenter via a dedicated 160 Gbps network connection and hence can access the remote EOS based storage with a high bandwidth. In the last few years, a cloud overlay based on OpenStack has been commissioned to use these resources for the WLCG when they are not needed for data taking. This online cloud facility was designed for parasitic use of the HLT, which must never interfere with its primary function as part of the DAQ system. It also allows to abstract from the different types of machines and their underlying segmented networks. During the LHC technical stop periods, the HLT cloud is set to its static mode of operation where it acts like other grid facilities. The online cloud was also extended to make dynamic use of resources during periods between LHC fills. These periods are a-priori unscheduled and of undetermined length, typically of several hours, once or more a day. For that, it dynamically follows LHC beam states and hibernates Virtual Machines (VM) accordingly. Finally, this work presents the design and implementation of a mechanism to dynamically ramp up VMs when the DAQ load on the HLT reduces towards the end of the fill.
- Research Organization:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
- Grant/Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1574987
- Report Number(s):
- CMS-CR--2018-398; FERMILAB-CONF--19-549-CMS; oai:inspirehep.net:1761581
- Journal Information:
- EPJ Web of Conferences, Journal Name: EPJ Web of Conferences Vol. 214; ISSN 2100-014X
- Publisher:
- EDP SciencesCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Repurposing of the Run 2 CMS High Level Trigger Infrastructure as a Cloud Resource for Offline Computing
A new event builder for CMS Run II
Status and trends in networking at LHC Tier1 facilities
Conference
·
Sun Dec 31 23:00:00 EST 2023
· EPJ Web Conf.
·
OSTI ID:2467535
A new event builder for CMS Run II
Journal Article
·
Tue Dec 22 19:00:00 EST 2015
· Journal of Physics. Conference Series
·
OSTI ID:1250527
Status and trends in networking at LHC Tier1 facilities
Conference
·
Fri Jun 22 00:00:00 EDT 2012
· J.Phys.Conf.Ser.
·
OSTI ID:1405161