You need JavaScript to view this

High Performance Experiment Data Archiving with gStore

Abstract

GSI in Darmstadt (Germany) is a center for heavy ion research. It hosts an Alice Tier2 center and is the home of the future FAIR facility. The planned data rates of the largest FAIR experiments, CBM and Panda, will be similar to those of the current LHC experiments at Cern. gStore is a hierarchical storage system with unique name space and successfully in operation since more than fifteen years. Its core consists of several tape libraries and currently {approx}20 data mover nodes connected within a SAN network. The gStore clients transfer data via fast socket connections from/to the disk cache of the data movers ({approx}200 TByte currently). Each data mover has also a high speed connection to the GSI lustre file system ({approx}3 PByte data capacity currently). The overall bandwidth between gStore (disk cache or tape) and lustre amounts to 5 GByte/s and will be duplicated in 2012. In the near future the lustre HSM functionality will be implemented with gStore. Each tape drive is accessible from any data mover, fully transparent to the users. The tapes and libraries are managed by commercial software (IBM Tivoli Storage Manager TSM), whereas the disk cache management and the TSM and user interfaces  More>>
Authors:
Goeringer, H; Feyerabend, M; Sedykh, S [1] 
  1. GSI Helmholtzzentrum fuer Schwerionenforschung - Center for Heavy Ion Research Planckstr. 1, D-64291 Darmstadt (Germany)
Publication Date:
Dec 13, 2012
Product Type:
Journal Article
Resource Relation:
Journal Name: Journal of Physics. Conference Series (Online); Journal Volume: 396; Journal Issue: 4; Conference: CHEP2012: International conference on computing in high energy and nuclear physics 2012, New York, NY (United States), 21-25 May 2012; Other Information: Country of input: International Atomic Energy Agency (IAEA)
Subject:
97 MATHEMATICAL METHODS AND COMPUTING; CERN LHC; COMPUTER CALCULATIONS; COMPUTER CODES; COMPUTER NETWORKS; DATA ACQUISITION; DATA TRANSMISSION; DESIGN; DISTRIBUTED DATA PROCESSING; GERMAN FR ORGANIZATIONS; MEMORY DEVICES; MEMORY MANAGEMENT; OPERATION; PARALLEL PROCESSING; PERFORMANCE
OSTI ID:
22079355
Country of Origin:
United Kingdom
Language:
English
Other Identifying Numbers:
Journal ID: ISSN 1742-6596; TRN: GB13O2483038150
Availability:
Available from http://dx.doi.org/10.1088/1742-6596/396/4/042023
Submitting Site:
INIS
Size:
[6 page(s)]
Announcement Date:
Apr 04, 2013

Citation Formats

Goeringer, H, Feyerabend, M, and Sedykh, S. High Performance Experiment Data Archiving with gStore. United Kingdom: N. p., 2012. Web. doi:10.1088/1742-6596/396/4/042023.
Goeringer, H, Feyerabend, M, & Sedykh, S. High Performance Experiment Data Archiving with gStore. United Kingdom. doi:10.1088/1742-6596/396/4/042023.
Goeringer, H, Feyerabend, M, and Sedykh, S. 2012. "High Performance Experiment Data Archiving with gStore." United Kingdom. doi:10.1088/1742-6596/396/4/042023. https://www.osti.gov/servlets/purl/10.1088/1742-6596/396/4/042023.
@misc{etde_22079355,
title = {High Performance Experiment Data Archiving with gStore}
author = {Goeringer, H, Feyerabend, M, and Sedykh, S}
abstractNote = {GSI in Darmstadt (Germany) is a center for heavy ion research. It hosts an Alice Tier2 center and is the home of the future FAIR facility. The planned data rates of the largest FAIR experiments, CBM and Panda, will be similar to those of the current LHC experiments at Cern. gStore is a hierarchical storage system with unique name space and successfully in operation since more than fifteen years. Its core consists of several tape libraries and currently {approx}20 data mover nodes connected within a SAN network. The gStore clients transfer data via fast socket connections from/to the disk cache of the data movers ({approx}200 TByte currently). Each data mover has also a high speed connection to the GSI lustre file system ({approx}3 PByte data capacity currently). The overall bandwidth between gStore (disk cache or tape) and lustre amounts to 5 GByte/s and will be duplicated in 2012. In the near future the lustre HSM functionality will be implemented with gStore. Each tape drive is accessible from any data mover, fully transparent to the users. The tapes and libraries are managed by commercial software (IBM Tivoli Storage Manager TSM), whereas the disk cache management and the TSM and user interfaces are provided by GSI software. This provides the flexibility needed to tailor gStore according to the always developing requirements of the GSI and FAIR user communities. For Alice users all gStore data are worldwide accessible via Alice grid software. Data streams from running experiments at GSI (up to 500 MByte/s) are written via sockets from the event builders to gStore write cache for migration to tape. In parallel the data are also copied to lustre for online evaluation and monitoring. As all features related to tapes and libraries are handled by TSM gStore is practically completely hardware independent. Additionally, according to the design principles gStore is fully scalable in data capacity and I/O bandwidth. Therefore we are optimistic to fulfill also the dramatically increased mass storage requirements of the FAIR experiments in 2018, which will be some orders of magnitude higher than those of today.}
doi = {10.1088/1742-6596/396/4/042023}
journal = {Journal of Physics. Conference Series (Online)}
issue = {4}
volume = {396}
journal type = {AC}
place = {United Kingdom}
year = {2012}
month = {Dec}
}