Fermilab's multi-petabyte scalable mass storage system
Conference
·
OSTI ID:879085
Fermilab provides a multi-Petabyte scale mass storage system for High Energy Physics (HEP) Experiments and other scientific endeavors. We describe the scalability aspects of the hardware and software architecture that were designed into the Mass Storage System to permit us to scale to multiple petabytes of storage capacity, manage tens of terabytes per day in data transfers, support hundreds of users, and maintain data integrity. We discuss in detail how we scale the system over time to meet the ever-increasing needs of the scientific community, and relate our experiences with many of the technical and economic issues related to scaling the system. Since the 2003 MSST conference, the experiments at Fermilab have generated more than 1.9 PB of additional data. We present results on how this system has scaled and performed for the Fermilab CDF and D0 Run II experiments as well as other HEP experiments and scientific endeavors.
- Research Organization:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC02-76CH03000
- OSTI ID:
- 879085
- Report Number(s):
- FERMILAB-CONF-05-597-CD
- Country of Publication:
- United States
- Language:
- English
Similar Records
Distributed processing and analysis of physics data in the D0 SAM system at Fermilab
Monitoring a petabyte scale storage system
The Fermilab data storage infrastructure
Technical Report
·
Thu Aug 30 00:00:00 EDT 2001
·
OSTI ID:785150
Monitoring a petabyte scale storage system
Conference
·
Tue Nov 30 23:00:00 EST 2004
·
OSTI ID:15016947
The Fermilab data storage infrastructure
Conference
·
Wed Feb 05 23:00:00 EST 2003
·
OSTI ID:807535