skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: UNITY: Unified Memory and File Space. In: ROSS '17 Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017, Article No. 6

Conference ·
 [1];  [2];  [2];  [2];  [2];  [1];  [1];  [1];  [1];  [1];  [3];  [3];  [3]
  1. Oak Ridge National Laboratory, MS, Oak Ridge, Tennessee
  2. Georgia Institute of Technology, Atlanta, Georgia
  3. Los Alamos National Laboratory, Los Alamos, New Mexico
+ Show Author Affiliations

This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memory-and file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1567649
Resource Relation:
Conference: 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017, Washingon, DC, USA, June 27 - 27, 2017
Country of Publication:
United States
Language:
English

References (26)

Transparently consistent asynchronous shared memory
  • Akkan, Hakan; Ionkov, Latchesar; Lang, Michael
  • Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '13 https://doi.org/10.1145/2491661.2481431
conference January 2013
The Common Communication Interface (CCI)
  • Atchley, Scott; Dillow, David; Shipman, Galen
  • 2011 IEEE 19th Annual Symposium on High-Performance Interconnects (HOTI), 2011 IEEE 19th Annual Symposium on High Performance Interconnects https://doi.org/10.1109/HOTI.2011.17
conference August 2011
Legion: Expressing locality and independence with logical regions
  • Bauer, Michael; Treichler, Sean; Slaughter, Elliott
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.71
conference November 2012
MarFS: A Scalable Near-POSIX Name Space over Cloud Objects – New Features report November 2016
NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories journal March 2011
System software for persistent memory conference January 2014
Data tiering in heterogeneous memory systems conference January 2016
Phoenix: Memory Speed HPC I/O with NVM conference December 2016
An overview of the HDF5 technology suite and its applications conference January 2011
Using MPI-2 book January 1999
Hop: Elastic Consistency for Exascale Data Stores book January 2015
DRepl: Optimizing access to application data for analysis and visualization conference May 2013
Asymmetric Memory Extension for Openshmem conference January 2014
pVM: persistent virtual memory for efficient capacity scaling and object storage conference January 2016
Optimizing Checkpoints Using NVM as Virtual Memory
  • Kannan, Sudarsun; Gavrilovska, Ada; Schwan, Karsten
  • 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on Parallel and Distributed Processing https://doi.org/10.1109/IPDPS.2013.69
conference May 2013
Energy Aware Persistence: Reducing Energy Overheads of Memory-based Persistence in NVMs
  • Kannan, Sudarsun; Qureshi, Moinuddin; Gavrilovksa, Ada
  • Proceedings of the 2016 International Conference on Parallel Architectures and Compilation - PACT '16 https://doi.org/10.1145/2967938.2967953
conference January 2016
On the role of burst buffers in leadership-class storage systems conference April 2012
DAOS and Friends: A Proposal for an Exascale Storage System
  • Lofstead, Jay; Jimenez, Ivo; Maltzahn, Carlos
  • SC16: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2016.49
conference November 2016
Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS)
  • Lofstead, Jay F.; Klasky, Scott; Schwan, Karsten
  • Proceedings of the 6th international workshop on Challenges of large applications in distributed environments - CLADE '08 https://doi.org/10.1145/1383529.1383533
conference January 2008
Scaling parallel I/O performance through I/O delegate and caching system conference November 2008
Enabling composite applications through an asynchronous shared memory interface conference October 2014
MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools conference January 2003
Characterizing emerging heterogeneous memory conference January 2016
Language support for dynamic, hierarchical data partitioning journal November 2013
Mnemosyne: lightweight persistent memory journal June 2012
Hitting the memory wall: implications of the obvious journal March 1995

Similar Records

UNITY: Unified Memory and File Space
Conference · Thu Jun 01 00:00:00 EDT 2017 · OSTI ID:1567649
+10 more
UNITY: Unified Memory and Storage Space
Technical Report · Tue Feb 11 00:00:00 EST 2020 · OSTI ID:1567649
Exascale Operating Systems and Runtime Software Report
Technical Report · Fri Dec 28 00:00:00 EST 2012 · OSTI ID:1567649
+7 more

Related Subjects