skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MarFS, Version 1

Abstract

There is a sea (mar is Spanish for sea) of data out there that needs to be handled efficiently. Object Stores are filling the hole of managing large amounts of data efficiently. However, in many cases, and our HPC case in particular, we need a traditional file (POSIX) interface to this data as HPC I/O models have not moved to object interfaces, such as Amazon S3, CDMI, etc.Eventually Object Store providers may deliver file interfaces to their object stores, but at this point those interfaces are not ready to do the job that we need done. MarFS will glue together two existing scalable components: a file system's scalable metadata component that provides the file interface; and existing scalable object stores (from one or more providers). There will be utilities to do work that is not critical to be done in real-time so that MarFS can manage the space used by objects and allocated to individual users.

Developers:
 [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Release Date:
Project Type:
Software Type:
Licenses:
Sponsoring Org.:
USDOE

Primary Award/Contract Number:
AC52-06NA25396
Code ID:
17297
Site Accession Number:
C15061
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Country of Origin:
United States

Citation Formats

Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, Dejager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, Torrez, Alfred, and USDOE. MarFS, Version 1. Computer software. https://www.osti.gov//servlets/purl/1468585. USDOE. 15 May. 2015. Web. doi:10.11578/dc.20180904.4.
Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, Dejager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, Torrez, Alfred, & USDOE. (2015, May 15). MarFS, Version 1 [Computer software]. https://www.osti.gov//servlets/purl/1468585. doi:10.11578/dc.20180904.4.
Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, Dejager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, Torrez, Alfred, and USDOE. MarFS, Version 1. Computer software. May 15, 2015. https://www.osti.gov//servlets/purl/1468585. doi:10.11578/dc.20180904.4.
@misc{osti_1468585,
title = {MarFS, Version 1},
author = {Inman, Jeffrey and Bonnie, David and Broomfield, Matthew and Chen, Hsing-Bung and Dejager, Christopher and Grider, Gary and Hoffman, Christopher and Kettering, Brett and Lamb, Kyle and Sherrill, Charles and Torrez, Alfred and USDOE},
abstractNote = {There is a sea (mar is Spanish for sea) of data out there that needs to be handled efficiently. Object Stores are filling the hole of managing large amounts of data efficiently. However, in many cases, and our HPC case in particular, we need a traditional file (POSIX) interface to this data as HPC I/O models have not moved to object interfaces, such as Amazon S3, CDMI, etc.Eventually Object Store providers may deliver file interfaces to their object stores, but at this point those interfaces are not ready to do the job that we need done. MarFS will glue together two existing scalable components: a file system's scalable metadata component that provides the file interface; and existing scalable object stores (from one or more providers). There will be utilities to do work that is not critical to be done in real-time so that MarFS can manage the space used by objects and allocated to individual users.},
url = {https://www.osti.gov//servlets/purl/1468585},
doi = {10.11578/dc.20180904.4},
year = {2015},
month = {5},
note =
}

Software:

Save / Share: