Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Operational experience with the new CMS DAQ-Expert

Journal Article · · EPJ Web of Conferences (Online)
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; « less
The data acquisition (DAQ) system of the Compact Muon Solenoid (CMS) at CERN reads out the detector at the level-1 trigger accept rate of 100 kHz, assembles events with a bandwidth of 200 GB/s, provides these events to the high level-trigger running on a farm of about 30k cores and records the accepted events. Comprising custom-built and cutting edge commercial hardware and several 1000 instances of software applications, the DAQ system is complex in itself and failures cannot be completely excluded. Moreover, problems in the readout of the detectors,in the first level trigger system or in the high level trigger may provoke anomalous behaviour of the DAQ systemwhich sometimes cannot easily be differentiated from a problem in the DAQ system itself. In order to achieve high data taking efficiency with operators from the entire collaboration and without relying too heavily on the on-call experts, an expert system, the DAQ-Expert, has been developed that can pinpoint the source of most failures and give advice to the shift crew on how to recover in the quickest way. The DAQ-Expert constantly analyzes monitoring data from the DAQ system and the high level trigger by making use of logic modules written in Java that encapsulate the expert knowledge about potential operational problems. The results of the reasoning are presented to the operator in a web-based dashboard, may trigger sound alerts in the control room and are archived for post-mortem analysis - presented in a web-based timeline browser. We present the design of the DAQ-Expert and report on the operational experience since 2017, when it was first put into production.
Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
CMS Collaboration
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1924318
Alternate ID(s):
OSTI ID: 23177520
Report Number(s):
CMS-CR-2018-406; FERMILAB-CONF-18-834-CMS; oai:inspirehep.net:1760511
Journal Information:
EPJ Web of Conferences (Online), Journal Name: EPJ Web of Conferences (Online) Vol. 214; ISSN 2100-014X
Publisher:
EDP SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (2)

First Operational Experience With a High-Energy Physics Run Control System Based on Web Technologies journal August 2012
The New CMS DAQ System for Run-2 of the LHC journal June 2015

Similar Records

DAQExpert the service to increase CMS data-taking efficiency
Conference · Tue Dec 31 23:00:00 EST 2019 · EPJ Web Conf. · OSTI ID:1842762
Mu2e DAQ and slow control systems
Journal Article · Tue Apr 26 20:00:00 EDT 2022 · EPJ Web of Conferences (Online) · OSTI ID:1856012
SIMDAQ -- A system for modeling DAQ/trigger systems
Journal Article · Wed Jan 31 23:00:00 EST 1996 · IEEE Transactions on Nuclear Science · OSTI ID:212104

Related Subjects

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY