Large File System Backup: NERSC Global File System Experience
NERSC's Global File system (NGF), accessible from all compute systems at NERSC, holds files and data from many scientific projects. A full backup of this file system to our High Performance Storage System (HPSS) is performed periodically. Disk storage usage by projects at NERSC has grown seven fold over a two year period, from ~;;20TB in June 2006 to ~;;140 TB in June 2008. The latest full backup took about 13 days and more than 200 T10k tape cartridges (.5 TB capacity). Petabyte file systems are becoming a reality in the next few years and the existing utilities are already strained in handling backup tasks.
- Research Organization:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Organization:
- National Energy Research Scientific Computing Division
- DOE Contract Number:
- DE-AC02-05CH11231
- OSTI ID:
- 941678
- Report Number(s):
- LBNL-1101E; TRN: US200902%%60
- Country of Publication:
- United States
- Language:
- English
Similar Records
Reliability Results of NERSC Systems
Oracle Database DBFS Hierarchical Storage Overview
Exploration of cache behavior using HPSS per-file transfer logs
Technical Report
·
Tue May 27 00:00:00 EDT 2008
·
OSTI ID:941678
+1 more
Oracle Database DBFS Hierarchical Storage Overview
Conference
·
Mon Jul 25 00:00:00 EDT 2011
·
OSTI ID:941678
Exploration of cache behavior using HPSS per-file transfer logs
Technical Report
·
Sat Nov 10 00:00:00 EST 2001
·
OSTI ID:941678