CMS conditions data access using FroNTier

Title: CMS conditions data access using FroNTier

Full Record
Other Related Research

Abstract

The CMS experiment at the LHC has established an infrastructure using the FroNTier framework to deliver conditions (i.e. calibration, alignment, etc.) data to processing clients worldwide. FroNTier is a simple web service approach providing client HTTP access to a central database service. The system for CMS has been developed to work with POOL which provides object relational mapping between the C++ clients and various database technologies. Because of the read only nature of the data, Squid proxy caching servers are maintained near clients and these caches provide high performance data access. Several features have been developed to make the system meet the needs of CMS including careful attention to cache coherency with the central database, and low latency loading required for the operation of the online High Level Trigger. The ease of deployment, stability of operation, and high performance make the FroNTier approach well suited to the GRID environment being used for CMS offline, as well as for the online environment used by the CMS High Level Trigger (HLT). The use of standard software, such as Squid and various monitoring tools, make the system reliable, highly configurable and easily maintained. We describe the architecture, software, deployment, performance, monitoring and overallmore » operational experience for the system.« less

Authors:: Blumenfeld, Barry J; Dykstra, David; Lueking, Lee; Wicklund, Eric

Publication Date:: 2007-10-01

Research Org.:: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 922731

Report Number(s):: FERMILAB-CONF-07-526-CD
TRN: US0801744

DOE Contract Number:: AC02-07CH11359

Resource Type:: Conference

Resource Relation:: Conference: Prepared for International Conference on Computing in High Energy and Nuclear Physics (CHEP 07), Victoria, BC, Canada, 2-7 Sep 2007

Country of Publication:: United States

Language:: English

Subject:: 99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; ALIGNMENT; ARCHITECTURE; CALIBRATION; MONITORING; NUCLEAR PHYSICS; PERFORMANCE; PROCESSING; STABILITY; Computing

Citation Formats


                    Blumenfeld, Barry J, /Johns Hopkins U., Dykstra, David, Lueking, Lee, Wicklund, Eric, and /Fermilab. CMS conditions data access using FroNTier.  United States: N. p., 2007. 
        Web.

Copy to clipboard


                    Blumenfeld, Barry J, /Johns Hopkins U., Dykstra, David, Lueking, Lee, Wicklund, Eric, & /Fermilab. CMS conditions data access using FroNTier.  United States.

Copy to clipboard


                    Blumenfeld, Barry J, /Johns Hopkins U., Dykstra, David, Lueking, Lee, Wicklund, Eric, and /Fermilab. Mon .  
        "CMS conditions data access using FroNTier".  United States.  https://www.osti.gov/servlets/purl/922731.

Copy to clipboard


                    
@article{osti_922731,

  title        = {CMS conditions data access using FroNTier},

  author       = {Blumenfeld, Barry J and /Johns Hopkins U. and Dykstra, David and Lueking, Lee and Wicklund, Eric and /Fermilab},

  abstractNote = {The CMS experiment at the LHC has established an infrastructure using the FroNTier framework to deliver conditions (i.e. calibration, alignment, etc.) data to processing clients worldwide. FroNTier is a simple web service approach providing client HTTP access to a central database service. The system for CMS has been developed to work with POOL which provides object relational mapping between the C++ clients and various database technologies. Because of the read only nature of the data, Squid proxy caching servers are maintained near clients and these caches provide high performance data access. Several features have been developed to make the system meet the needs of CMS including careful attention to cache coherency with the central database, and low latency loading required for the operation of the online High Level Trigger. The ease of deployment, stability of operation, and high performance make the FroNTier approach well suited to the GRID environment being used for CMS offline, as well as for the online environment used by the CMS High Level Trigger (HLT). The use of standard software, such as Squid and various monitoring tools, make the system reliable, highly configurable and easily maintained. We describe the architecture, software, deployment, performance, monitoring and overall operational experience for the system.},

  doi          = {},

  url          = {https://www.osti.gov/biblio/922731},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2007},

  month        = {10}

}

Copy to clipboard

Conference:

View Conference

Other availability

Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

Operational Experience with the Frontier System in CMS

Conference Blumenfeld, Barry ; Dykstra, Dave ; Kreuzer, Peter ; ... - J.Phys.Conf.Ser.

The Frontier framework is used in the CMS experiment at the LHC to deliver conditions data to processing clients worldwide, including calibration, alignment, and configuration information. Each central server at CERN, called a Frontier Launchpad, uses tomcat as a servlet container to establish the communication between clients and the central Oracle database. HTTP-proxy Squid servers, located close to clients, cache the responses to queries in order to provide high performance data access and to reduce the load on the central Oracle database. Each Frontier Launchpad also has its own reverse-proxy Squid for caching. The three central servers have been deliveringmore »« less
https://doi.org/10.1088/1742-6596/396/5/052014

Full Text Available
Understanding the evolution of conditions data access through Frontier for the ATLAS Experiment

Journal Article Svatos, Michal ; De Salvo, Alessandro ; Dewhurst, Alastair ; ... - EPJ Web of Conferences

The ATLAS Distributed Computing system uses the Frontier system to access the Conditions, Trigger, and Geometry database data stored in the Oracle Offline Database at CERN by means of the HTTP protocol. All ATLAS computing sites use Squid web proxies to cache the data, greatly reducing the load on the Frontier servers and the databases. One feature of the Frontier client is that in the event of failure, it retries with different services. While this allows transient errors and scheduled maintenance to happen transparently, it does open the system up to cascading failures if the load is high enough. Throughoutmore »« less
https://doi.org/10.1051/epjconf/201921403020

Full Text Available
Belle II Conditions Database

Journal Article Ritter, Martin ; Wood, Lynn ; Kuhr, T. ; ... - Journal of Physics. Conference Series

The Belle II experiment at KEK is preparing for taking first collision data in early 2018. For the success of the experiment it is essential to have information about varying conditions available to systems worldwide in a fast and efficient manner that is straightforward for both the user and maintainer. The Belle II Conditions Database was designed to make maintenance as easy as possible. To this end, a HTTP REST service was developed with industry-standard tools such as Swagger for the API interface development, Payara for the Java EE application server, and the Hazelcast in-memory data grid for support ofmore »« less
Cited by 1
https://doi.org/10.1088/1742-6596/1085/3/032032

Full Text Available
Greatly improved cache update times for conditions data with Frontier/Squid

Conference Dykstra, Dave ; Lueking, Lee ; /Fermilab

The CMS detector project loads copies of conditions data to over 100,000 computer cores worldwide by using a software subsystem called Frontier. This subsystem translates database queries into HTTP, looks up the results in a central database at CERN, and caches the results in an industry-standard HTTP proxy/caching server called Squid. One of the most challenging aspects of any cache system is coherency, that is, ensuring that changes made to the underlying data get propagated out to all clients in a timely manner. Recently, the Frontier system was enhanced to drastically reduce the time for changes to be propagated everywheremore »« less
Full Text Available
Web Proxy Auto Discovery for the WLCG

Journal Article Dykstra, D. ; Blomer, J. ; Blumenfeld, B. ; ... - Journal of Physics. Conference Series

All four of the LHC experiments depend on web proxies (that is, squids) at each grid site to support software distribution by the CernVM FileSystem (CVMFS). CMS and ATLAS also use web proxies for conditions data distributed through the Frontier Distributed Database caching system. ATLAS & CMS each have their own methods for their grid jobs to find out which web proxies to use for Frontier at each site, and CVMFS has a third method. Those diverse methods limit usability and flexibility, particularly for opportunistic use cases, where an experiment’s jobs are run at sites that do not primarily supportmore »« less
https://doi.org/10.1088/1742-6596/898/5/052043

Full Text Available

Similar Records