Large File System Backup: NERSC Global File System Experience
NERSC's Global File system (NGF), accessible from all compute systems at NERSC, holds files and data from many scientific projects. A full backup of this file system to our High Performance Storage System (HPSS) is performed periodically. Disk storage usage by projects at NERSC has grown seven fold over a two year period, from ~;;20TB in June 2006 to ~;;140 TB in June 2008. The latest full backup took about 13 days and more than 200 T10k tape cartridges (.5 TB capacity). Petabyte file systems are becoming a reality in the next few years and the existing utilities are already strained in handling backup tasks.
- Research Organization:
- Ernest Orlando Lawrence Berkeley National Laboratory, Berkeley, CA (US)
- Sponsoring Organization:
- National Energy Research Scientific Computing Division
- DOE Contract Number:
- AC02-05CH11231
- OSTI ID:
- 941678
- Report Number(s):
- LBNL-1101E
- Country of Publication:
- United States
- Language:
- English
Similar Records
Reliability Results of NERSC Systems
A beta test of linear tape-open (LTO) ultrium data storage technology
Oracle Database DBFS Hierarchical Storage Overview
Technical Report
·
Tue May 27 00:00:00 EDT 2008
·
OSTI ID:934480
A beta test of linear tape-open (LTO) ultrium data storage technology
Technical Report
·
Tue Oct 30 23:00:00 EST 2001
·
OSTI ID:791803
Oracle Database DBFS Hierarchical Storage Overview
Conference
·
Mon Jul 25 00:00:00 EDT 2011
·
OSTI ID:1022938