Use of glide-ins in CMS for production and analysis

Conference · Fri Jan 01 04:00:00 EST 2010 · J.Phys.Conf.Ser.219:072013,2010

DOI:https://doi.org/10.1088/1742-6596/219/7/072013· OSTI ID:983374

Bradley, D; Gutsche, O; Hahn, K; Holzman, B; Padhi, S; Pi, H; Spiga, D; Sfiligoi, I; Vaandering, E; Wurthwein, F

With the evolution of various grid federations, the Condor glide-ins represent a key feature in providing a homogeneous pool of resources using late-binding technology. The CMS collaboration uses the glide-in based Workload Management System, glideinWMS, for production (ProdAgent) and distributed analysis (CRAB) of the data. The Condor glide-in daemons traverse to the worker nodes, submitted via Condor-G. Once activated, they preserve the Master-Worker relationships, with the worker first validating the execution environment on the worker node before pulling the jobs sequentially until the expiry of their lifetimes. The combination of late-binding and validation significantly reduces the overall failure rate visible to CMS physicists. We discuss the extensive use of the glideinWMS since the computing challenge, CCRC-08, in order to prepare for the forthcoming LHC data-taking period. The key features essential to the success of large-scale production and analysis on CMS resources across major grid federations, including EGEE, OSG and NorduGrid are outlined. Use of glide-ins via the CRAB server mechanism and ProdAgent, as well as first hand experience of using the next generation CREAM computing element within the CMS framework is discussed.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL
• Sponsoring Organization: USDOE
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 983374
• Report Number(s): FERMILAB-CONF-09-717-CD
• Conference Information: Journal Name: J.Phys.Conf.Ser.219:072013,2010
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
Computing
Instrumentation
MANAGEMENT
NUCLEAR PHYSICS
PRODUCTION
VALIDATION