Scalable filesystem enumeration and metadata operations

Patent · Tue Mar 16 04:00:00 EDT 2021

OSTI ID:1805635

Grider, Gary A.

Systems, apparatus, and methods are disclosed for performing scalable operations in a file system, including POSIX-like file systems. Metadata entries in a namespace or directory tree are sharded across multiple file metadata servers. An enumeration operation, such as listing a directory, is parallelized across the multiple file metadata servers, while retaining standard functionality transparently to clients. Other enumeration operations include no-output operations such as changing file attributes or deleting a file, and cumulative operations such as counting total disk space usage. The parallelization is compatible with tree-level parallelization and storage-level parallelization. Disclosed technologies can be applied to other fields requiring scalable enumeration, such as database and network applications.

• Research Organization: Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC52-06NA25396
• Assignee: Triad National Security, LLC (Los Alamos, NM)
• Patent Number(s): 10,949,387
• Application Number: 15/713,492
• OSTI ID: 1805635
• Country of Publication: United States
• Language: English