Title: Scalable filesystem enumeration and metadata operations

Abstract

Systems, apparatus, and methods are disclosed for performing scalable operations in a file system, including POSIX-like file systems. Metadata entries in a namespace or directory tree are sharded across multiple file metadata servers. An enumeration operation, such as listing a directory, is parallelized across the multiple file metadata servers, while retaining standard functionality transparently to clients. Other enumeration operations include no-output operations such as changing file attributes or deleting a file, and cumulative operations such as counting total disk space usage. The parallelization is compatible with tree-level parallelization and storage-level parallelization. Disclosed technologies can be applied to other fields requiring scalable enumeration, such as database and network applications.

Inventors:

Grider, Gary A.

Issue Date:

Tue Mar 16 00:00:00 EDT 2021

Research Org.:

Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Org.:

USDOE

OSTI Identifier:

1805635

Patent Number(s):

10949387

Application Number:

15/713,492

Assignee:

Triad National Security, LLC (Los Alamos, NM)

Patent Classifications (CPCs):

G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING

Show more

G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING

G06F16/134 - {Distributed indices}
G06F16/14 - Details of searching files based on file metadata
G06F16/162 - {Delete operations
G06F16/1767 - {Concurrency control, e.g. optimistic or pessimistic approaches}
G06F16/2246 - {Trees, e.g. B+trees}

Show less

DOE Contract Number:  

AC52-06NA25396

Resource Type:

Patent

Resource Relation:

Patent File Date: 09/22/2017

Country of Publication:

United States

Language:

English