skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MarFS, Version 1

Abstract

There is a sea (mar is Spanish for sea) of data out there that needs to be handled efficiently. Object Stores are filling the hole of managing large amounts of data efficiently. However, in many cases, and our HPC case in particular, we need a traditional file (POSIX) interface to this data as HPC I/O models have not moved to object interfaces, such as Amazon S3, CDMI, etc.Eventually Object Store providers may deliver file interfaces to their object stores, but at this point those interfaces are not ready to do the job that we need done. MarFS will glue together two existing scalable components: a file system's scalable metadata component that provides the file interface; and existing scalable object stores (from one or more providers). There will be utilities to do work that is not critical to be done in real-time so that MarFS can manage the space used by objects and allocated to individual users.

Authors:
; ; ; ; ; ; ; ; ; ;
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
Contributing Org.:
Los Alamos National Laboratory
OSTI Identifier:
1400375
Report Number(s):
MarFS v.1; 005495WKSTN00
C15061
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Software
Software Revision:
00
Software Package Number:
005495
Software CPU:
WKSTN
Open Source:
Yes
MarFS is released under the BSD license.
Source Code Available:
No
Country of Publication:
United States

Citation Formats

Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, DeJager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, and Torrez, Alfred. MarFS, Version 1. Computer software. https://www.osti.gov//servlets/purl/1400375. Vers. 00. USDOE. 15 May. 2015. Web.
Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, DeJager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, & Torrez, Alfred. (2015, May 15). MarFS, Version 1 (Version 00) [Computer software]. https://www.osti.gov//servlets/purl/1400375.
Inman, Jeffrey, Bonnie, David, Broomfield, Matthew, Chen, Hsing-Bung, DeJager, Christopher, Grider, Gary, Hoffman, Christopher, Kettering, Brett, Lamb, Kyle, Sherrill, Charles, and Torrez, Alfred. MarFS, Version 1. Computer software. Version 00. May 15, 2015. https://www.osti.gov//servlets/purl/1400375.
@misc{osti_1400375,
title = {MarFS, Version 1, Version 00},
author = {Inman, Jeffrey and Bonnie, David and Broomfield, Matthew and Chen, Hsing-Bung and DeJager, Christopher and Grider, Gary and Hoffman, Christopher and Kettering, Brett and Lamb, Kyle and Sherrill, Charles and Torrez, Alfred},
abstractNote = {There is a sea (mar is Spanish for sea) of data out there that needs to be handled efficiently. Object Stores are filling the hole of managing large amounts of data efficiently. However, in many cases, and our HPC case in particular, we need a traditional file (POSIX) interface to this data as HPC I/O models have not moved to object interfaces, such as Amazon S3, CDMI, etc.Eventually Object Store providers may deliver file interfaces to their object stores, but at this point those interfaces are not ready to do the job that we need done. MarFS will glue together two existing scalable components: a file system's scalable metadata component that provides the file interface; and existing scalable object stores (from one or more providers). There will be utilities to do work that is not critical to be done in real-time so that MarFS can manage the space used by objects and allocated to individual users.},
url = {https://www.osti.gov//servlets/purl/1400375},
doi = {},
year = {2015},
month = {5},
note =
}

Software:
To order this software, request consultation services, or receive further information, please fill out the following request.

Save / Share:

To receive further information, fill out the request form below. OSTI staff will begin to process an order for scientific and technical software once the signed site license agreement is received. You may also reach us by email at: .

Software Request

(required)
(required)
(required)
(required)
(required)
(required)
(required)
(required)