Development of fibre channel disk clusters. Final report for period September 2, 1998 - March 17, 1999
This report documents the accomplishments of a Phase I project whose purpose was to demonstrate feasibility of developing inexpensive and fast data storage using multi-host Fibre Channel disk clusters. In Phase I, a working file system called ZFS was developed and tested. The ZFS approach was designed to be suited for high energy physics applications, but is general and flexible enough to be useful for other high-volume applications. The ZFS approach, which borrows from the networking concept of cut-through routing, uses Linux boxes and disk clusters in a Fibre Channel--Arbitrated Loop architecture. In ZFS, file locking and other meta-data level operations are carried out over the primary data network, after which all data are sent directly over a Fibre Channel between the workstation and the disk cluster. No intermediate server is required. Substantially higher throughputs than in traditional networked disk architectures have been demonstrated. The ZFS architecture is described and tests of the first implementation of ZFS at Fermilab are discussed. The current system is implemented for Linux and is being optimized for Fermilab's needs, but extensions to other operating systems and other data-intensive applications are clearly foreseen.
- Research Organization:
- Quantum Research Services, Inc., Durham, NC (US)
- Sponsoring Organization:
- USDOE Office of Energy Research (ER) (US)
- DOE Contract Number:
- FG02-98ER82648
- OSTI ID:
- 770613
- Report Number(s):
- DOE/ER/82648; TRN: US0101191
- Resource Relation:
- Other Information: PBD: 1 Aug 1999
- Country of Publication:
- United States
- Language:
- English
Similar Records
A next-generation parallel file system for Linux cluster.
Input/Output Scalability of Genomic Alignment: How to Configure a Computational Biology Cluster