skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Scalability and performance improvements in the Fermilab Mass Storage System

Abstract

By 2009 the Fermilab Mass Storage System had encountered two major challenges: the required amount of data stored and accessed in both tiers of the system (dCache and Enstore) had significantly increased and the number of clients accessing Mass Storage System had increased from tens to hundreds of nodes and from hundreds to thousands of parallel requests. To address these challenges Enstore and the SRM part of dCache were modified to scale for performance, access rates, and capacity. This work increased the amount of simultaneously processed requests in a single Enstore Library instance from about 1000 to 30000. The rates of incoming requests to Enstore increased from tens to hundreds per second. Fermilab is invested in LTO4 tape technology and we have investigated both LTO5 and Oracle T10000C to cope with the increasing needs in capacity. We have decided to adopt T10000C, mainly due to its large capacity, which allows us to scale up the existing robotic storage space by a factor 6. This paper describes the modifications and investigations that allowed us to meet these scalability and performance challenges and provided some perspectives of Fermilab Mass Storage System.

Authors:
 [1];  [1];  [1];  [1];  [1]
  1. Fermilab
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP)
OSTI Identifier:
1405098
Report Number(s):
FERMILAB-CONF-12-289-CD
1215001
DOE Contract Number:  
AC02-07CH11359
Resource Type:
Conference
Journal Name:
J.Phys.Conf.Ser.
Additional Journal Information:
Journal Volume: 396; Conference: 19th International Conference on Computing in High Energy and Nuclear Physics, New York, USA, 05/21-05/25/2012
Country of Publication:
United States
Language:
English

Citation Formats

Crawford, Matt, Dumitrescu, Catalin, Litvintsev, Dmitry, Moibenko, Alexander, and Oleynik, Gene. Scalability and performance improvements in the Fermilab Mass Storage System. United States: N. p., 2012. Web. doi:10.1088/1742-6596/396/5/052024.
Crawford, Matt, Dumitrescu, Catalin, Litvintsev, Dmitry, Moibenko, Alexander, & Oleynik, Gene. Scalability and performance improvements in the Fermilab Mass Storage System. United States. https://doi.org/10.1088/1742-6596/396/5/052024
Crawford, Matt, Dumitrescu, Catalin, Litvintsev, Dmitry, Moibenko, Alexander, and Oleynik, Gene. 2012. "Scalability and performance improvements in the Fermilab Mass Storage System". United States. https://doi.org/10.1088/1742-6596/396/5/052024. https://www.osti.gov/servlets/purl/1405098.
@article{osti_1405098,
title = {Scalability and performance improvements in the Fermilab Mass Storage System},
author = {Crawford, Matt and Dumitrescu, Catalin and Litvintsev, Dmitry and Moibenko, Alexander and Oleynik, Gene},
abstractNote = {By 2009 the Fermilab Mass Storage System had encountered two major challenges: the required amount of data stored and accessed in both tiers of the system (dCache and Enstore) had significantly increased and the number of clients accessing Mass Storage System had increased from tens to hundreds of nodes and from hundreds to thousands of parallel requests. To address these challenges Enstore and the SRM part of dCache were modified to scale for performance, access rates, and capacity. This work increased the amount of simultaneously processed requests in a single Enstore Library instance from about 1000 to 30000. The rates of incoming requests to Enstore increased from tens to hundreds per second. Fermilab is invested in LTO4 tape technology and we have investigated both LTO5 and Oracle T10000C to cope with the increasing needs in capacity. We have decided to adopt T10000C, mainly due to its large capacity, which allows us to scale up the existing robotic storage space by a factor 6. This paper describes the modifications and investigations that allowed us to meet these scalability and performance challenges and provided some perspectives of Fermilab Mass Storage System.},
doi = {10.1088/1742-6596/396/5/052024},
url = {https://www.osti.gov/biblio/1405098}, journal = {J.Phys.Conf.Ser.},
number = ,
volume = 396,
place = {United States},
year = {Sun Jan 01 00:00:00 EST 2012},
month = {Sun Jan 01 00:00:00 EST 2012}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: