Lustre Distributed Name Space (DNE) Evaluation at the Oak Ridge Leadership Computing Facility (OLCF)

Technical Report · Mon Aug 22 00:00:00 EDT 2016

DOI:https://doi.org/10.2172/1302888· OSTI ID:1302888

Simmons, James S. ^[1]; Leverman, Dustin B. ^[1]; Hanley, Jesse A. ^[1]; Oral, Sarp ^[1]

---

1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Center for Computational Sciences

This document describes the Lustre Distributed Name Space (DNE) evaluation carried at the Oak Ridge Leadership Computing Facility (OLCF) between 2014 and 2015. DNE is a development project funded by the OpenSFS, to improve Lustre metadata performance and scalability. The development effort has been split into two parts, the first part (DNE P1) providing support for remote directories over remote Lustre Metadata Server (MDS) nodes and Metadata Target (MDT) devices, while the second phase (DNE P2) addressed split directories over multiple remote MDS nodes and MDT devices. The OLCF have been actively evaluating the performance, reliability, and the functionality of both DNE phases. For these tests, internal OLCF testbed were used. Results are promising and OLCF is planning on a full DNE deployment by mid-2016 timeframe on production systems.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
• Sponsoring Organization: USDOE Office of Science (SC)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1302888
• Report Number(s): ORNL/TM-2015/608
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING