New capabilities in the HENP grand challenge storage access systemand its application at RHIC
The High Energy and Nuclear Physics Data Access GrandChallenge project has developed an optimizing storage access softwaresystem that was prototyped at RHIC. It is currently undergoingintegration with the STAR experiment in preparation for data taking thatstarts in mid-2000. The behavior and lessons learned in the RHIC MockData Challenge exercises are described as well as the observedperformance under conditions designed to characterize scalability. Up to250 simultaneous queries were tested and up to 10 million events across 7event components were involved in these queries. The system coordinatesthe staging of "bundles" of files from the HPSS tape system, so that allthe needed components of each event are in disk cache when accessed bythe application software. The caching policy algorithm for thecoordinated bundle staging is described in the paper. The initialprototype implementation interfaced to the Objectivity/DB. In this latestversion, it evolved to work with arbitrary files and use CORBA interfacesto the tag database and file catalog services. The interface to the tagdatabase and the MySQL-based file catalog services used by STAR aredescribed along with the planned usage scenarios.
- Research Organization:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Organization:
- USDOE Director, Office of Science. Division of NuclearPhysics
- DOE Contract Number:
- DE-AC02-05CH11231
- OSTI ID:
- 901026
- Report Number(s):
- LBNL-45551; R&D Project: NGC; TRN: US0702435
- Resource Relation:
- Conference: Computing in High Energy and Nuclear Physics,Padova, Italy, February 7 - 11, 2000
- Country of Publication:
- United States
- Language:
- English
Similar Records
Grid Data Access on Widely Distributed Worker Nodes Using Scalla and SRM
Query estimation and order-optimized iteration in very large federations