Approaches for a reliable high-performance distributed-parallel storage system
Conference
·
OSTI ID:421392
- Jackson State Univ., MS (United States)
- Lawrence Berkeley National Lab., Berkeley, CA (United States)
This paper studies different schemes to enhance the reliability, availability and security of a high-performance distributed storage system. We have previously designed a distributed parallel storage system that employs the aggregate bandwidth of multiple data servers connected by a high-speed wide-area network to achieve scalability and high data throughout. The general approach of this paper employs ensure error correcting codes to add data redundancy that can be used to retrieve missing information caused by hardware, software, or human faults. The paper suggests techniques for reducing the communication and computation overhead incurred while retrieving missing data blocks from redundant information. These techniques include clustering, multidimensional coding, and the full two-dimensional parity scheme.
- DOE Contract Number:
- AC03-76SF00098
- OSTI ID:
- 421392
- Report Number(s):
- CONF-960835--
- Country of Publication:
- United States
- Language:
- English
Similar Records
3D Coded SUMMA: Communication-Efficient and Robust Parallel Matrix Multiplication
Using high speed networks to enable distributed parallel image server systems
Initial Characterization of Parallel NFS Implementations
Conference
·
Sat Aug 01 00:00:00 EDT 2020
·
OSTI ID:1651320
Using high speed networks to enable distributed parallel image server systems
Conference
·
Fri Dec 30 23:00:00 EST 1994
·
OSTI ID:87661
Initial Characterization of Parallel NFS Implementations
Conference
·
Thu Dec 31 23:00:00 EST 2009
·
OSTI ID:982407