Makalu: fast recoverable allocation of non-volatile memory

Bhandari, Kumud; Chakrabarti, Dhruva R.; Boehm, Hans-J.

doi:10.1145/2983990.2984019

Makalu: fast recoverable allocation of non-volatile memory

Journal Article · Wed Oct 19 00:00:00 EDT 2016 · SIGPLAN

DOI:https://doi.org/10.1145/2983990.2984019· OSTI ID:1425366

Bhandari, Kumud ^[1]; Chakrabarti, Dhruva R. ^[2]; Boehm, Hans-J. ^[3]

Rice Univ., Houston, TX (United States); Hewlett Packard Labs., Palo Alto, CA (United States); Rice University and Hewlett Packard Labs, USA
Hewlett Packard Labs., Palo Alto, CA (United States)
Google Inc., Mountain View, CA (United States)

Byte addressable non-volatile memory (NVRAM) is likely to supplement, and perhaps eventually replace, DRAM. Applications can then persist data structures directly in memory instead of serializing them and storing them onto a durable block device. However, failures during execution can leave data structures in NVRAM unreachable or corrupt. In this paper, we present Makalu, a system that addresses non-volatile memory management. Makalu offers an integrated allocator and recovery-time garbage collector that maintains internal consistency, avoids NVRAM memory leaks, and is efficient, all in the face of failures. We show that a careful allocator design can support a less restrictive and a much more familiar programming model than existing persistent memory allocators. Our allocator significantly reduces the per allocation persistence overhead by lazily persisting non-essential metadata and by employing a post-failure recovery-time garbage collector. Experimental results show that the resulting online speed and scalability of our allocator are comparable to well-known transient allocators, and significantly better than state-of-the-art persistent allocators.

View Accepted Manuscript (DOE)

Research Organization:: Hewlett Packard Labs., Palo Alto, CA (United States); Rice Univ., Houston, TX (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)

Grant/Contract Number:: SC0012199

OSTI ID:: 1425366

Journal Information:: SIGPLAN, Journal Name: SIGPLAN Journal Issue: 10 Vol. 51; ISSN 0362-1340

Publisher:: ACMCopyright Statement

Country of Publication:: United States

Language:: English

References (38)

Matrix Algebra Searle, Shayle R. Encyclopedia of Biostatistics https://doi.org/10.1002/0470011815.b2a13039	book	July 2005
Garbage collection in an uncooperative environment Boehm, Hans-Juergen; Weiser, Mark Software: Practice and Experience, Vol. 18, Issue 9 https://doi.org/10.1002/spe.4380180902	journal	September 1988
Matrix Algebra Gentle, James E. Springer Texts in Statistics https://doi.org/10.1007/978-0-387-70873-7	book	January 2007
Matrix Algebra Dhrymes, Phoebus J. Mathematics for Econometrics https://doi.org/10.1007/978-1-4757-1691-7_2	book	January 1978
Matrix Algebra Gentle, James E. Springer Texts in Statistics https://doi.org/10.1007/978-3-319-64867-5	book	January 2017
Orthogonal Persistence Revisited Dearle, Alan; Kirby, Graham N. C.; Morrison, Ron Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-14681-7_1	book	January 2010
Matrix Algebra: Using MATLAB Lindfield, George; Penny, John Numerical Methods https://doi.org/10.1016/b978-0-12-812256-3.00020-8	book	January 2019
Matrix Algebra Freedman, David A. Cambridge University Press https://doi.org/10.1017/cbo9780511815867.005	book	June 2012
A hierarchical O(N log N) force-calculation algorithm Barnes, Josh; Hut, Piet Nature, Vol. 324, Issue 6096 https://doi.org/10.1038/324446a0	journal	December 1986
The missing memristor found Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R. Nature, Vol. 453, Issue 7191 https://doi.org/10.1038/nature06932	journal	May 2008
McRT-Malloc: a scalable transactional memory allocator Hudson, Richard L.; Saha, Bratin; Adl-Tabatabai, Ali-Reza Proceedings of the 2006 international symposium on Memory management - ISMM '06 https://doi.org/10.1145/1133956.1133967	conference	January 2006
Explicit solutions to the N -queens problem for all N Bernhardsson, Bo ACM SIGART Bulletin, Vol. 2, Issue 2 https://doi.org/10.1145/122319.122322	journal	February 1991
Architecting phase change memory as a scalable dram alternative Lee, Benjamin C.; Ipek, Engin; Mutlu, Onur Proceedings of the 36th annual international symposium on Computer architecture - ISCA '09 https://doi.org/10.1145/1555754.1555758	conference	January 2009
Scalable high performance main memory system using phase-change memory technology Qureshi, Moinuddin K.; Srinivasan, Vijayalakshmi; Rivers, Jude A. Proceedings of the 36th annual international symposium on Computer architecture - ISCA '09 https://doi.org/10.1145/1555754.1555760	conference	January 2009
Disaggregated memory for expansion and sharing in blade servers Lim, Kevin; Chang, Jichuan; Mudge, Trevor Proceedings of the 36th annual international symposium on Computer architecture - ISCA '09 https://doi.org/10.1145/1555754.1555789	conference	January 2009
Architecting phase change memory as a scalable dram alternative Lee, Benjamin C.; Ipek, Engin; Mutlu, Onur ACM SIGARCH Computer Architecture News, Vol. 37, Issue 3 https://doi.org/10.1145/1555815.1555758	journal	June 2009
Scalable high performance main memory system using phase-change memory technology Qureshi, Moinuddin K.; Srinivasan, Vijayalakshmi; Rivers, Jude A. ACM SIGARCH Computer Architecture News, Vol. 37, Issue 3 https://doi.org/10.1145/1555815.1555760	journal	June 2009
Disaggregated memory for expansion and sharing in blade servers Lim, Kevin; Chang, Jichuan; Mudge, Trevor ACM SIGARCH Computer Architecture News, Vol. 37, Issue 3 https://doi.org/10.1145/1555815.1555789	journal	June 2009
Mnemosyne: lightweight persistent memory Volos, Haris; Tack, Andres Jaan; Swift, Michael M. Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems - ASPLOS '11 https://doi.org/10.1145/1950365.1950379	conference	January 2011
NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories Coburn, Joel; Caulfield, Adrian M.; Akel, Ameen Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems - ASPLOS '11 https://doi.org/10.1145/1950365.1950380	conference	January 2011
NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories Coburn, Joel; Caulfield, Adrian M.; Akel, Ameen ACM SIGPLAN Notices, Vol. 46, Issue 3 https://doi.org/10.1145/1961296.1950380	journal	March 2011
Simple, fast, and practical non-blocking and blocking concurrent queue algorithms Michael, Maged M.; Scott, Michael L. Proceedings of the fifteenth annual ACM symposium on Principles of distributed computing - PODC '96 https://doi.org/10.1145/248052.248106	conference	January 1996
Using managed runtime systems to tolerate holes in wearable memories Gao, Tiejun; Strauss, Karin; Blackburn, Stephen M. Proceedings of the 34th ACM SIGPLAN conference on Programming language design and implementation - PLDI '13 https://doi.org/10.1145/2491956.2462171	conference	January 2013
Using managed runtime systems to tolerate holes in wearable memories Gao, Tiejun; Strauss, Karin; Blackburn, Stephen M. ACM SIGPLAN Notices, Vol. 48, Issue 6 https://doi.org/10.1145/2499370.2462171	journal	June 2013
Atlas: leveraging locks for non-volatile memory consistency Chakrabarti, Dhruva R.; Boehm, Hans-J.; Bhandari, Kumud Proceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications - OOPSLA '14 https://doi.org/10.1145/2660193.2660224	conference	January 2014
SuperMalloc: a super fast multithreaded malloc for 64-bit machines Kuszmaul, Bradley C. Proceedings of the 2015 ACM SIGPLAN International Symposium on Memory Management - ISMM 2015 https://doi.org/10.1145/2754169.2754178	conference	January 2015
Fast, multicore-scalable, low-fragmentation memory allocation through large virtual memory and global data structures Aigner, Martin; Kirsch, Christoph M.; Lippautz, Michael Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications - OOPSLA 2015 https://doi.org/10.1145/2814270.2814294	conference	January 2015
Fast, multicore-scalable, low-fragmentation memory allocation through large virtual memory and global data structures Aigner, Martin; Kirsch, Christoph M.; Lippautz, Michael ACM SIGPLAN Notices, Vol. 50, Issue 10 https://doi.org/10.1145/2858965.2814294	journal	December 2015
Memory allocation for long-running server applications Larson, Per-Åke; Krishnan, Murali Proceedings of the first international symposium on Memory management - ISMM '98 https://doi.org/10.1145/286860.286880	conference	January 1998
SuperMalloc: a super fast multithreaded malloc for 64-bit machines Kuszmaul, Bradley C. ACM SIGPLAN Notices, Vol. 50, Issue 11 https://doi.org/10.1145/2887746.2754178	journal	January 2016
Memory allocation for long-running server applications Larson, Per-Åke; Krishnan, Murali ACM SIGPLAN Notices, Vol. 34, Issue 3 https://doi.org/10.1145/301589.286880	journal	March 1999
Mostly-copying reachability-based orthogonal persistence Hosking, Antony L.; Chen, Jiawan Proceedings of the 14th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications - OOPSLA '99 https://doi.org/10.1145/320384.320427	conference	January 1999
Mostly-copying reachability-based orthogonal persistence Hosking, Antony L.; Chen, Jiawan ACM SIGPLAN Notices, Vol. 34, Issue 10 https://doi.org/10.1145/320385.320427	journal	October 1999
Conservative garbage collection for general memory allocators Rodriguez-Rivera, Gustavo Proceedings of the second international symposium on Memory management - ISMM '00 https://doi.org/10.1145/362422.362464	conference	January 2000
Hoard: a scalable memory allocator for multithreaded applications Berger, Emery D.; McKinley, Kathryn S.; Blumofe, Robert D. Proceedings of the ninth international conference on Architectural support for programming languages and operating systems - ASPLOS-IX https://doi.org/10.1145/378993.379232	conference	January 2000
Reducing pause time of conservative collectors Endo, Toshio; Taura, Kenjiro Proceedings of the third international symposium on Memory management - ISMM '02 https://doi.org/10.1145/512429.512432	conference	January 2002
Reducing pause time of conservative collectors Endo, Toshio; Taura, Kenjiro ACM SIGPLAN Notices, Vol. 38, Issue 2 supplement https://doi.org/10.1145/773039.512432	journal	February 2003
Simple, Fast, and Practical Non-Blocking and Blocking Concurrent Queue Algorithms. Michael, Maged M.; Scott, Michael L. https://doi.org/10.21236/ada309412	report	December 1995

Cited By (15)

An Analysis of Persistent Memory Use with WHISPER Nalli, Sanketh; Haria, Swapnil; Hill, Mark D. ACM SIGPLAN Notices, Vol. 52, Issue 4 https://doi.org/10.1145/3093336.3037730	journal	May 2017
A Case for Asymmetric Non-Volatile Memory Architecture Ma, Teng; Zhang, Mingxing; Chen, Kang arXiv https://doi.org/10.48550/arxiv.1809.09395	preprint	January 2018
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference Ankit, Aayush; Hajj, Izzat El; Chalamalasetti, Sai Rahul arXiv https://doi.org/10.48550/arxiv.1901.10351	preprint	January 2019
Fine-Grain Checkpointing with In-Cache-Line Logging Cohen, Nachshon; Aksun, David T.; Avni, Hillel arXiv https://doi.org/10.48550/arxiv.1902.00660	text	January 2019
An Empirical Guide to the Behavior and Use of Scalable Persistent Memory Yang, Jian; Kim, Juno; Hoseinzadeh, Morteza arXiv https://doi.org/10.48550/arxiv.1908.03583	preprint	January 2019
Transactions on Red-black and AVL trees in NVRAM Schütt, Thorsten; Schintke, Florian; Skrzypczak, Jan arXiv https://doi.org/10.48550/arxiv.2006.16284	preprint	January 2020
WITCHER : Detecting Crash Consistency Bugs in Non-volatile Memory Programs Fu, Xinwei; Kim, Wook-Hee; Shreepathi, Ajay Paddayuru arXiv https://doi.org/10.48550/arxiv.2012.06086	preprint	January 2020
Flat-Combining-Based Persistent Data Structures for Non-Volatile Memory Rusanovsky, Matan; Attiya, Hagit; Ben-Baruch, Ohad arXiv https://doi.org/10.48550/arxiv.2012.12868	preprint	January 2020
An Analysis of Persistent Memory Use with WHISPER Nalli, Sanketh; Haria, Swapnil; Hill, Mark D. ASPLOS '17: Architectural Support for Programming Languages and Operating Systems, Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems https://doi.org/10.1145/3037697.3037730	conference	April 2017
An Analysis of Persistent Memory Use with WHISPER Nalli, Sanketh; Haria, Swapnil; Hill, Mark D. ACM SIGOPS Operating Systems Review, Vol. 51, Issue 2 https://doi.org/10.1145/3093315.3037730	journal	April 2017
An Analysis of Persistent Memory Use with WHISPER Nalli, Sanketh; Haria, Swapnil; Hill, Mark D. ACM SIGARCH Computer Architecture News, Vol. 45, Issue 1 https://doi.org/10.1145/3093337.3037730	journal	May 2017
Espresso: Brewing Java For More Non-Volatility with Non-volatile Memory Wu, Mingyu; Zhao, Ziming; Li, Haoyu ASPLOS '18: Architectural Support for Programming Languages and Operating Systems, Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems https://doi.org/10.1145/3173162.3173201	conference	March 2018
A persistent lock-free queue for non-volatile memory Friedman, Michal; Herlihy, Maurice; Marathe, Virendra PPoPP '18: 23nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Proceedings of the 23rd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming https://doi.org/10.1145/3178487.3178490	conference	February 2018
A persistent lock-free queue for non-volatile memory Friedman, Michal; Herlihy, Maurice; Marathe, Virendra ACM SIGPLAN Notices, Vol. 53, Issue 1 https://doi.org/10.1145/3200691.3178490	journal	March 2018
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference Ankit, Aayush; Hajj, Izzat El; Chalamalasetti, Sai Rahul ASPLOS '19: Architectural Support for Programming Languages and Operating Systems, Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems https://doi.org/10.1145/3297858.3304049	conference	April 2019

Similar Records

SharP Unified Memory Allocator: An Intent-Based Memory Allocator for Extreme-Scale Systems

Conference · Wed Aug 01 00:00:00 EDT 2018 · OSTI ID:1468045

Persistent Octrees for Parallel Mesh Refinement Through Non-Volatile Byte-Addressable Memory

Journal Article · Thu Aug 30 00:00:00 EDT 2018 · IEEE Transactions on Parallel and Distributed Systems · OSTI ID:1469556

Single-node Partitioned-Memory for Huge Graph Analytics: Cost and Performance Trade-offs

Conference · Sat Nov 13 23:00:00 EST 2021 · OSTI ID:1836010

Related Subjects

97 MATHEMATICS AND COMPUTING
allocation
deallocation
garbage collection
languages
non-volatile memory
performance
persistent memory management
reliability

Makalu: fast recoverable allocation of non-volatile memory

Citation Formats

References (38)

Cited By (15)

Similar Records

Related Subjects