SAMGrid integration of SRMs

Conference · Wed Dec 01 04:00:00 EST 2004

OSTI ID:15016972

Kennedy, R D; Baranovski, A; Garzoglio, G; Illingworth, R; Kreymer, A; Kumar, A; Loebel-Carpenter, L; Lueking, L; Lyon, A; Merritt, W; Terekhov, I; Trumbo, J; Veseli, S; White, S; Burgon-Lyon, M; Denis, R; Belforte, S; Kerzel, U; Bartsch, V; Leslie, M ; Stonjek, S

SAMGrid is the shared data handling framework of the two large Fermilab Run II collider experiments: DZero and CDF. In production since 1999 at D0, and going into production at CDF, the SAMGrid framework has been adapted over time to accommodate a variety of storage solutions and configurations, as well as the differing data processing models of these two experiments. This has been very successful for both experiments. Backed by primary data repositories of approximately 1 PB in size for each experiment, the SAMGrid framework delivers over 100 TB/day to DZero and CDF analyses at Fermilab and around the world. Each of the storage systems used with SAMGrid, however, has distinct interfaces, protocols, and behaviors. This led to different levels of integration of the various storage devices into the framework, which complicated the exploitation of their functionality and limited in some cases SAMGrid expansion across the experiments Grid. In an effort to simplify the SAMGrid storage interfaces, SAMGrid is adopting the Storage Resource Manager (SRM) concept as the universal interface to all storage devices. This simplifies the SAMGrid framework, especially the implementation of storage device interactions. It prepares the SAMGrid framework for future storage solutions equipped with SRM interfaces, without the need for long and risky software integration projects. In principle, any storage device with an SRM interface can be used with the SAMGrid framework. The integration of SRMs is an important further step towards evolving the SAMGrid framework into a co-operating collection of distinct, modular grid-oriented services. This report outlines how the SRMs are being integrated into the existing SAMGrid framework without disturbing on-going operations.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL
• Sponsoring Organization: USDOE
• DOE Contract Number: AC02-76CH03000
• OSTI ID: 15016972
• Report Number(s): FERMILAB-CONF-04-490-CD
• Country of Publication: United States
• Language: English

Related Subjects

43 PARTICLE ACCELERATORS
99 GENERAL AND MISCELLANEOUS
COMPUTERS
Computing
DATA PROCESSING
FERMILAB
FERMILAB COLLIDER DETECTOR
IMPLEMENTATION
PHYSICS
PRODUCTION
STORAGE