Distributed data access and resource management in the D0 SAM system
- Fermilab
SAM (Sequential Access through Meta-data) is the data access and job management system for the D0 high energy physics experiment at Fermilab. The SAM system is being developed and used to handle the Petabyte-scale experiment data, accessed by hundreds of D0 collaborators scattered around the world. In this paper, we present solutions to some of the distributed data processing problems from the perspective of real experience dealing with mission-critical data. We concentrate on the distributed disk caching, resource management and job control. The system has elements of the Grid Computing and has features applicable to data-intensive computing in general.
- Research Organization:
- Fermi National Accelerator Lab., Batavia, IL (US)
- Sponsoring Organization:
- USDOE Office of Energy Research (ER) (US)
- DOE Contract Number:
- AC02-76CH03000
- OSTI ID:
- 781989
- Report Number(s):
- FERMILAB-Conf-01/101
- Country of Publication:
- United States
- Language:
- English
Similar Records
Distributed processing and analysis of physics data in the D0 SAM system at Fermilab
The D0 Experiment Data Grid: SAM
Distributed data access in the sequential access model at the D0 experiment at Fermilab
Technical Report
·
Thu Aug 30 00:00:00 EDT 2001
·
OSTI ID:785150
The D0 Experiment Data Grid: SAM
Journal Article
·
Sat Sep 01 00:00:00 EDT 2001
· Lect.Notes Comput.Sci.
·
OSTI ID:1900204
Distributed data access in the sequential access model at the D0 experiment at Fermilab
Conference
·
Wed Jul 05 00:00:00 EDT 2000
·
OSTI ID:757586