skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multi-terabyte EIDE disk arrays running Linux RAID5

Abstract

High-energy physics experiments are currently recording large amounts of data and in a few years will be recording prodigious quantities of data. New methods must be developed to handle this data and make analysis at universities possible. Grid Computing is one method; however, the data must be cached at the various Grid nodes. We examine some storage techniques that exploit recent developments in commodity hardware. Disk arrays using RAID level 5 (RAID-5) include both parity and striping. The striping improves access speed. The parity protects data in the event of a single disk failure, but not in the case of multiple disk failures. We report on tests of dual-processor Linux Software RAID-5 arrays and Hardware RAID-5 arrays using a 12-disk 3ware controller, in conjunction with 250 and 300 GB disks, for use in offline high-energy physics data analysis. The price of IDE disks is now less than $1/GB. These RAID-5 disk arrays can be scaled to sizes affordable to small institutions and used when fast random access at low cost is important.

Authors:
; ; ; ; ; ;
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
15017013
Report Number(s):
FERMILAB-CONF-04-285-CD-E
arXiv eprint number physics/0411188; TRN: US0605240
DOE Contract Number:  
AC02-76CH03000
Resource Type:
Conference
Resource Relation:
Conference: Presented at Computing in High-Energy Physics (CHEP '04), Interlaken, Switzerland, 27 Sep - 1 Oct 2004
Country of Publication:
United States
Language:
English
Subject:
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; DATA ANALYSIS; PARITY; PHYSICS; PRICES; STORAGE; VELOCITY; Instrumentation

Citation Formats

Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, and /Fermilab. Multi-terabyte EIDE disk arrays running Linux RAID5. United States: N. p., 2004. Web.
Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, & /Fermilab. Multi-terabyte EIDE disk arrays running Linux RAID5. United States.
Sanders, D A, Cremaldi, L M, Eschenburg, V, Godang, R, Joy, M D, Summers, D J, /Mississippi U., Petravick, D L, and /Fermilab. 2004. "Multi-terabyte EIDE disk arrays running Linux RAID5". United States. https://www.osti.gov/servlets/purl/15017013.
@article{osti_15017013,
title = {Multi-terabyte EIDE disk arrays running Linux RAID5},
author = {Sanders, D A and Cremaldi, L M and Eschenburg, V and Godang, R and Joy, M D and Summers, D J and /Mississippi U. and Petravick, D L and /Fermilab},
abstractNote = {High-energy physics experiments are currently recording large amounts of data and in a few years will be recording prodigious quantities of data. New methods must be developed to handle this data and make analysis at universities possible. Grid Computing is one method; however, the data must be cached at the various Grid nodes. We examine some storage techniques that exploit recent developments in commodity hardware. Disk arrays using RAID level 5 (RAID-5) include both parity and striping. The striping improves access speed. The parity protects data in the event of a single disk failure, but not in the case of multiple disk failures. We report on tests of dual-processor Linux Software RAID-5 arrays and Hardware RAID-5 arrays using a 12-disk 3ware controller, in conjunction with 250 and 300 GB disks, for use in offline high-energy physics data analysis. The price of IDE disks is now less than $1/GB. These RAID-5 disk arrays can be scaled to sizes affordable to small institutions and used when fast random access at low cost is important.},
doi = {},
url = {https://www.osti.gov/biblio/15017013}, journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Nov 01 00:00:00 EST 2004},
month = {Mon Nov 01 00:00:00 EST 2004}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: