The D0 Experiment Data Grid: SAM
Journal Article
·
· Lect.Notes Comput.Sci.
- Fermilab
SAM (Sequential Access through Meta-data) is a data grid and data cataloging system developed for the D0 high energy physics (HEP) experiment at Fermilab. Since March 2001 , D0 has been acquiring data in real time from the detector and will archive up to 1/2 Petabyte a year of simulated, raw detector and processed physics data. SAM catalogs the event and calibration data, provides distributed file delivery and caching services, and manages the processing and analysis jobs for the hundreds of D0 collaborators around the world. The D0 applications are data-intensive and the physics analysis programs execute on the order of 1- 1000 cpuseconds per 250KByte of data. SAM manages the transfer of data between the archival storage systems through the globally distributed disk caches and delivers the data files to the users batch and interactive jobs. Additionally, SAM handles the user job requests and execution scheduling, and manages the use of the available compute, storage and network resources to implement experiment resource allocation policies. D0 has been using early versions of the SAM system for two years for the management of the simulation and test data. The system is in production use with round the clock support. D0 is a participant in the Particle Physics Data Grid (PPDG) project. Aspects of the ongoing SAM developments are in collaboration with the computer science groups and other experiments on PPDG. The D0 emphasis is to develop the more sophisticated global grid job, resource management, authentication and information services needed to fully meet the needs of the experiment during the next 6 years of data taking and analysis.
- Research Organization:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
- DOE Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1900204
- Report Number(s):
- FERMILAB-PUB-01-238-E; oai:inspirehep.net:563477
- Journal Information:
- Lect.Notes Comput.Sci., Journal Name: Lect.Notes Comput.Sci. Vol. 2242; ISSN 0302-9743
- Country of Publication:
- United States
- Language:
- English
Similar Records
Distributed data access and resource management in the D0 SAM system
Distributed processing and analysis of physics data in the D0 SAM system at Fermilab
Distributed data access in the sequential access model at the D0 experiment at Fermilab
Conference
·
Tue Jun 26 00:00:00 EDT 2001
·
OSTI ID:781989
Distributed processing and analysis of physics data in the D0 SAM system at Fermilab
Technical Report
·
Thu Aug 30 00:00:00 EDT 2001
·
OSTI ID:785150
Distributed data access in the sequential access model at the D0 experiment at Fermilab
Conference
·
Wed Jul 05 00:00:00 EDT 2000
·
OSTI ID:757586