Multi-terabyte EIDE disk arrays running Linux RAID5
Abstract
High-energy physics experiments are currently recording large amounts of data and in a few years will be recording prodigious quantities of data. New methods must be developed to handle this data and make analysis at universities possible. Grid Computing is one method; however, the data must be cached at the various Grid nodes. We examine some storage techniques that exploit recent developments in commodity hardware. Disk arrays using RAID level 5 (RAID-5) include both parity and striping. The striping improves access speed. The parity protects data in the event of a single disk failure, but not in the case of multiple disk failures. We report on tests of dual-processor Linux Software RAID-5 arrays and Hardware RAID-5 arrays using a 12-disk 3ware controller, in conjunction with 250 and 300 GB disks, for use in offline high-energy physics data analysis. The price of IDE disks is now less than $1/GB. These RAID-5 disk arrays can be scaled to sizes affordable to small institutions and used when fast random access at low cost is important.
- Authors:
- Publication Date:
- Research Org.:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 15017013
- Report Number(s):
- FERMILAB-CONF-04-285-CD-E
arXiv eprint number physics/0411188; TRN: US0605240
- DOE Contract Number:
- AC02-76CH03000
- Resource Type:
- Conference
- Resource Relation:
- Conference: Presented at Computing in High-Energy Physics (CHEP '04), Interlaken, Switzerland, 27 Sep - 1 Oct 2004
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; DATA ANALYSIS; PARITY; PHYSICS; PRICES; STORAGE; VELOCITY; Instrumentation
Citation Formats
Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, and /Fermilab. Multi-terabyte EIDE disk arrays running Linux RAID5. United States: N. p., 2004.
Web.
Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, & /Fermilab. Multi-terabyte EIDE disk arrays running Linux RAID5. United States.
Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, and /Fermilab. 2004.
"Multi-terabyte EIDE disk arrays running Linux RAID5". United States. https://www.osti.gov/servlets/purl/15017013.
@article{osti_15017013,
title = {Multi-terabyte EIDE disk arrays running Linux RAID5},
author = {Sanders, D A and Cremaldi, L M and Eschenburg, V and Godang, R and Joy, M D and Summers, D J and /Mississippi U. and Petravick, D L and /Fermilab},
abstractNote = {High-energy physics experiments are currently recording large amounts of data and in a few years will be recording prodigious quantities of data. New methods must be developed to handle this data and make analysis at universities possible. Grid Computing is one method; however, the data must be cached at the various Grid nodes. We examine some storage techniques that exploit recent developments in commodity hardware. Disk arrays using RAID level 5 (RAID-5) include both parity and striping. The striping improves access speed. The parity protects data in the event of a single disk failure, but not in the case of multiple disk failures. We report on tests of dual-processor Linux Software RAID-5 arrays and Hardware RAID-5 arrays using a 12-disk 3ware controller, in conjunction with 250 and 300 GB disks, for use in offline high-energy physics data analysis. The price of IDE disks is now less than $1/GB. These RAID-5 disk arrays can be scaled to sizes affordable to small institutions and used when fast random access at low cost is important.},
doi = {},
url = {https://www.osti.gov/biblio/15017013},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Nov 01 00:00:00 EST 2004},
month = {Mon Nov 01 00:00:00 EST 2004}
}