UNITY: Unified Memory and File Space. In: ROSS '17 Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017, Article No. 6
- Oak Ridge National Laboratory, MS, Oak Ridge, Tennessee
- Georgia Institute of Technology, Atlanta, Georgia
- Los Alamos National Laboratory, Los Alamos, New Mexico
This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memory-and file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1567649
- Resource Relation:
- Conference: 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017, Washingon, DC, USA, June 27 - 27, 2017
- Country of Publication:
- United States
- Language:
- English
Transparently consistent asynchronous shared memory
|
conference | January 2013 |
The Common Communication Interface (CCI)
|
conference | August 2011 |
Legion: Expressing locality and independence with logical regions
|
conference | November 2012 |
MarFS: A Scalable Near-POSIX Name Space over Cloud Objects – New Features | report | November 2016 |
NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories
|
journal | March 2011 |
System software for persistent memory
|
conference | January 2014 |
Data tiering in heterogeneous memory systems
|
conference | January 2016 |
Phoenix: Memory Speed HPC I/O with NVM
|
conference | December 2016 |
An overview of the HDF5 technology suite and its applications
|
conference | January 2011 |
Using MPI-2 | book | January 1999 |
Hop: Elastic Consistency for Exascale Data Stores
|
book | January 2015 |
DRepl: Optimizing access to application data for analysis and visualization
|
conference | May 2013 |
Asymmetric Memory Extension for Openshmem
|
conference | January 2014 |
pVM: persistent virtual memory for efficient capacity scaling and object storage
|
conference | January 2016 |
Optimizing Checkpoints Using NVM as Virtual Memory
|
conference | May 2013 |
Energy Aware Persistence: Reducing Energy Overheads of Memory-based Persistence in NVMs
|
conference | January 2016 |
On the role of burst buffers in leadership-class storage systems
|
conference | April 2012 |
DAOS and Friends: A Proposal for an Exascale Storage System
|
conference | November 2016 |
Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS)
|
conference | January 2008 |
Scaling parallel I/O performance through I/O delegate and caching system
|
conference | November 2008 |
Enabling composite applications through an asynchronous shared memory interface
|
conference | October 2014 |
MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools
|
conference | January 2003 |
Characterizing emerging heterogeneous memory
|
conference | January 2016 |
Language support for dynamic, hierarchical data partitioning
|
journal | November 2013 |
Mnemosyne: lightweight persistent memory
|
journal | June 2012 |
Hitting the memory wall: implications of the obvious
|
journal | March 1995 |
Similar Records
UNITY: Unified Memory and Storage Space
Exascale Operating Systems and Runtime Software Report