skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Scalable Near-POSIX Name Space over Cloud Objects – Production Experience and New Features

  1. Los Alamos National Laboratory
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
OSTI Identifier:
Report Number(s):
DOE Contract Number:
Resource Type:
Resource Relation:
Conference: MSST ; 2017-05-15 - 2017-05-19 ; Santa Clara, California, United States
Country of Publication:
United States
Computer Hardware; Computer Science

Citation Formats

Bonnie, David John. A Scalable Near-POSIX Name Space over Cloud Objects – Production Experience and New Features. United States: N. p., 2017. Web.
Bonnie, David John. A Scalable Near-POSIX Name Space over Cloud Objects – Production Experience and New Features. United States.
Bonnie, David John. 2017. "A Scalable Near-POSIX Name Space over Cloud Objects – Production Experience and New Features". United States. doi:.
title = {A Scalable Near-POSIX Name Space over Cloud Objects – Production Experience and New Features},
author = {Bonnie, David John},
abstractNote = {},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = 2017,
month = 5

Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • No abstract provided.
  • The engineering forces driving development of “cloud” storage have produced resilient, cost-effective storage systems that can scale to 100s of petabytes, with good parallel access and bandwidth. These features would make a good match for the vast storage needs of High-Performance Computing datacenters, but cloud storage gains some of its capability from its use of HTTP-style Representational State Transfer (REST) semantics, whereas most large datacenters have legacy applications that rely on POSIX file-system semantics. MarFS is an open-source project at Los Alamos National Laboratory that allows us to present cloud-style object-storage as a scalable near-POSIX file system. We have alsomore » developed a new storage architecture to improve bandwidth and scalability beyond what’s available in commodity object stores, while retaining their resilience and economy. Additionally, we present a scheme for scaling the POSIX interface to allow billions of files in a single directory and trillions of files in total.« less
  • Checkpoint-Restart is one of the most used software approaches to achieve fault-tolerance in high-end clusters. While standard techniques typically focus on user-level solutions, the advent of virtualization software has enabled efficient and transparent system-level approaches. In this paper, we present a scalable transparent system-level solution to address fault-tolerance for applications based on global address space (GAS) programming models on Infiniband clusters. In addition to handling communication, the solution addresses transparent checkpoint of user-generated files. We exploit the support for the Infiniband network in the Xen virtual machine environment. We have developed a version of the Aggregate Remote Memory Copy Interfacemore » (ARMCI) one-sided communication library capable of suspending and resuming applications. We present efficient and scalable mechanisms to distribute checkpoint requests and to backup virtual machines memory images and file systems. We tested our approach in the context of NWChem, a popular computational chemistry suite. We demonstrated that NWChem can be executed, without any modification to the source code, on a virtualized 8-node cluster with very little overhead (below 3%). We observe that the total checkpoint time is limited by disk I/O. Finally, we measured system-size depended components of the checkpoint time on up to 1024 cores (128 nodes), demonstrating the scalability of our approach in medium/large-scale systems.« less
  • Practically all space objects with onboard nuclear power sources stay in earth satellite orbits with an orbital lifetime long enough to reduce their radioactivity to levels presenting no danger for the Earth population. One of the reasons for orbit lifetime reduction can be collisions with other space objects in near-earth orbits. The possible consequence of collisions can be partial, or even complete, destruction of the spacecraft with an onboard nuclear power source; as well as delivery of additional impulse both to the spacecraft and its fragments. It is shown that collisions in orbit do not cause increase of radiation hazardmore » for the Earth population if there is aerodynamic breakup of nuclear power sources into fragments of safe sizes during atmospheric reentry.« less
  • The development of surveillance technologies based on remote detection of anomalies of gaseous (atomic) composition of media near the location of industrial objects, underground storages oil and gas mains, as well as along trajectories of space objects are reported. Remote correlation spectroscopy of gaseous plumes and development of surveillance technologies are discussed.