A study of the viability of exploiting memory content similarity to improve resilience to memory errors

Levy, Scott; Ferreira, Kurt B.; Bridges, Patrick G.; Thompson, Aidan P.; Trott, Christian

doi:10.1177/1094342014560354

A study of the viability of exploiting memory content similarity to improve resilience to memory errors

Journal Article · Tue Dec 09 00:00:00 EST 2014 · International Journal of High Performance Computing Applications

DOI:https://doi.org/10.1177/1094342014560354· OSTI ID:1111407

Levy, Scott ^[1]; Ferreira, Kurt B. ^[2]; Bridges, Patrick G. ^[1]; Thompson, Aidan P. ^[2]; Trott, Christian ^[2]

Univ. of New Mexico, Albuquerque, NM (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Building the next-generation of extreme-scale distributed systems will require overcoming several challenges related to system resilience. As the number of processors in these systems grow, the failure rate increases proportionally. One of the most common sources of failure in large-scale systems is memory. In this paper, we propose a novel runtime for transparently exploiting memory content similarity to improve system resilience by reducing the rate at which memory errors lead to node failure. We evaluate the viability of this approach by examining memory snapshots collected from eight high-performance computing (HPC) applications and two important HPC operating systems. Based on the characteristics of the similarity uncovered, we conclude that our proposed approach shows promise for addressing system resilience in large-scale systems.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1111407

Report Number(s):: SAND--2013-8030J; 476178

Journal Information:: International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 1 Vol. 29; ISSN 1094-3420

Publisher:: SAGECopyright Statement

Country of Publication:: United States

Language:: English

References (38)

The general birthday problem Holst, Lars Random Structures & Algorithms, Vol. 6, Issue 2-3 https://doi.org/10.1002/rsa.3240060207	journal	March 1995
Fast Parallel Algorithms for Short-Range Molecular Dynamics Plimpton, Steve Journal of Computational Physics, Vol. 117, Issue 1 https://doi.org/10.1006/jcph.1995.1039	journal	March 1995
libhashckpt: Hash-Based Incremental Checkpointing Using GPU’s Ferreira, Kurt B.; Riesen, Rolf; Brighwell, Ron Recent Advances in the Message Passing Interface https://doi.org/10.1007/978-3-642-24449-0_31	book	January 2011
Cooperative Application/OS DRAM Fault Recovery Bridges, Patrick G.; Hoemmen, Mark; Ferreira, Kurt B. Euro-Par 2011: Parallel Processing Workshops https://doi.org/10.1007/978-3-642-29740-3_28	book	January 2012
CTH: A three-dimensional shock wave physics code McGlaun, J. M.; Thompson, S. L.; Elrick, M. G. International Journal of Impact Engineering, Vol. 10, Issue 1-4 https://doi.org/10.1016/0734-743x(90)90071-3	journal	January 1990
Spectral neighbor analysis method for automated generation of quantum-accurate interatomic potentials Thompson, A. P.; Swiler, L. P.; Trott, C. R. Journal of Computational Physics, Vol. 285 https://doi.org/10.1016/j.jcp.2014.12.018	journal	March 2015
BoomerAMG: A parallel algebraic multigrid solver and preconditioner Henson, Van Emden; Yang, Ulrike Meier Applied Numerical Mathematics, Vol. 41, Issue 1 https://doi.org/10.1016/s0168-9274(01)00115-5	journal	April 2002
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons Bartók, Albert P.; Payne, Mike C.; Kondor, Risi Physical Review Letters, Vol. 104, Issue 13 https://doi.org/10.1103/physrevlett.104.136403	journal	April 2010
Impact of Technology and Voltage Scaling on the Soft Error Susceptibility in Nanoscale CMOS Chandra, Vikas; Aitken, Robert 2008 IEEE International Symposium on Defect and Fault Tolerance of VLSI Systems https://doi.org/10.1109/dft.2008.50	conference	October 2008
DEBAR: A scalable high-performance de-duplication storage system for backup and archiving Yang, Tianming; Jiang, Hong; Feng, Dan 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/ipdps.2010.5470468	conference	January 2010
Palacios and Kitten: New high performance operating systems for scalable virtualized and native supercomputing Lange, John; Pedretti, Kevin; Hudson, Trammell 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/ipdps.2010.5470482	conference	January 2010
Exploiting Data Similarity to Reduce Memory Footprints Biswas, Susmit; Supinski, Bronis R. de; Schulz, Martin 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/ipdps.2011.24	conference	May 2011
Investigating the Impact of the Cielo Cray XE6 Architecture on Scientific Application Codes Vaughan, Courtenay; Rajan, Mahesh; Barrett, Richard 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum https://doi.org/10.1109/ipdps.2011.342	conference	May 2011
Uncoordinated Checkpointing Without Domino Effect for Send-Deterministic MPI Applications Guermouche, Amina; Ropars, Thomas; Brunet, Elisabeth Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/ipdps.2011.95	conference	May 2011
Checkpointing for peta-scale systems: a look into the future of practical rollback-recovery Elnozahy, E. N.; Plank, J. S. IEEE Transactions on Dependable and Secure Computing, Vol. 1, Issue 2 https://doi.org/10.1109/tdsc.2004.15	journal	April 2004
A Large-Scale Study of Failures in High-Performance Computing Systems Schroeder, Bianca; Gibson, Garth A. IEEE Transactions on Dependable and Secure Computing, Vol. 7, Issue 4 https://doi.org/10.1109/tdsc.2009.4	journal	October 2010
Memory resource management in VMware ESX server Waldspurger, Carl A. Proceedings of the 5th symposium on Operating systems design and implementation - OSDI '02 https://doi.org/10.1145/1060289.1060307	conference	January 2002
Evaluating the viability of process replication reliability for exascale systems Ferreira, Kurt; Stearley, Jon; Laros, James H. Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063443	conference	January 2011
Cosmic rays don't strike twice Hwang, Andy A.; Stefanovici, Ioan A.; Schroeder, Bianca ACM SIGARCH Computer Architecture News, Vol. 40, Issue 1 https://doi.org/10.1145/2189750.2150989	journal	March 2012
A case for tracking and exploiting inter-node and intra-node memory content sharing in virtualized large-scale parallel systems Xia, Lei; Dinda, Peter A. Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date https://doi.org/10.1145/2287056.2287061	conference	June 2012
Evaluating operating system vulnerability to memory errors Ferreira, Kurt B.; Pedretti, Kevin; Brightwell, Ron Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers https://doi.org/10.1145/2318916.2318930	conference	June 2012
Disco Bugnion, Edouard; Devine, Scott; Govil, Kinshuk ACM Transactions on Computer Systems, Vol. 15, Issue 4 https://doi.org/10.1145/265924.265930	journal	November 1997
A survey of rollback-recovery protocols in message-passing systems Elnozahy, E. N. (Mootaz); Alvisi, Lorenzo; Wang, Yi-Min ACM Computing Surveys, Vol. 34, Issue 3 https://doi.org/10.1145/568522.568525	journal	September 2002
Recovery in distributed systems using asynchronous message logging and checkpointing Johnson, David B.; Zwaenepoel, Willy Proceedings of the seventh annual ACM Symposium on Principles of distributed computing - PODC '88 https://doi.org/10.1145/62546.62575	conference	January 1988
CTH: A three-dimensional shock wave physics code McGlaun, J. M.; Thompson, S. L.; Elrick, M. G. International Journal of Impact Engineering, Vol. 10, Issue 1-4 https://doi.org/10.1016/0734-743X(90)90071-3	journal	January 1990
BoomerAMG: A parallel algebraic multigrid solver and preconditioner Henson, Van Emden; Yang, Ulrike Meier Applied Numerical Mathematics, Vol. 41, Issue 1 https://doi.org/10.1016/S0168-9274(01)00115-5	journal	April 2002
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons Bartók, Albert P.; Payne, Mike C.; Kondor, Risi Physical Review Letters, Vol. 104, Issue 13 https://doi.org/10.1103/PhysRevLett.104.136403	journal	April 2010
Impact of Technology and Voltage Scaling on the Soft Error Susceptibility in Nanoscale CMOS Chandra, Vikas; Aitken, Robert 2008 IEEE International Symposium on Defect and Fault Tolerance of VLSI Systems https://doi.org/10.1109/DFT.2008.50	conference	October 2008
Algorithm-based checkpoint-free fault tolerance for parallel matrix computations on volatile resources No authors listed Proceedings 20th IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2006.1639333	conference	January 2006
DEBAR: A scalable high-performance de-duplication storage system for backup and archiving Yang, Tianming; Jiang, Hong; Feng, Dan 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/IPDPS.2010.5470468	conference	January 2010
Palacios and Kitten: New high performance operating systems for scalable virtualized and native supercomputing Lange, John; Pedretti, Kevin; Hudson, Trammell 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/IPDPS.2010.5470482	conference	January 2010
Exploiting Data Similarity to Reduce Memory Footprints Biswas, Susmit; Supinski, Bronis R. de; Schulz, Martin 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.24	conference	May 2011
Investigating the Impact of the Cielo Cray XE6 Architecture on Scientific Application Codes Vaughan, Courtenay; Rajan, Mahesh; Barrett, Richard 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum https://doi.org/10.1109/IPDPS.2011.342	conference	May 2011
Uncoordinated Checkpointing Without Domino Effect for Send-Deterministic MPI Applications Guermouche, Amina; Ropars, Thomas; Brunet, Elisabeth Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.95	conference	May 2011
Checkpointing for peta-scale systems: a look into the future of practical rollback-recovery Elnozahy, E. N.; Plank, J. S. IEEE Transactions on Dependable and Secure Computing, Vol. 1, Issue 2 https://doi.org/10.1109/TDSC.2004.15	journal	April 2004
Difference engine Gupta, Diwaker; Lee, Sangmin; Vrable, Michael Communications of the ACM, Vol. 53, Issue 10 https://doi.org/10.1145/1831407.1831429	journal	October 2010
Cosmic rays don't strike twice: understanding the nature of DRAM errors and the implications for system design Hwang, Andy A.; Stefanovici, Ioan A.; Schroeder, Bianca Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems - ASPLOS '12 https://doi.org/10.1145/2150976.2150989	conference	January 2012
Memory resource management in VMware ESX server Waldspurger, Carl A. ACM SIGOPS Operating Systems Review, Vol. 36, Issue SI https://doi.org/10.1145/844128.844146	journal	December 2002

Similar Records

CoREC: Scalable and Resilient In-memory Data Staging for In-situ Workflows

Journal Article · Sat May 30 20:00:00 EDT 2020 · ACM Transactions on Parallel Computing · OSTI ID:1769940

PLEXUS: A Pattern-Oriented Runtime System Architecture for Resilient Extreme-Scale High-Performance Computing Systems

Conference · Mon Nov 30 23:00:00 EST 2020 · OSTI ID:1766396

Rolex: Resilience-oriented language extensions for extreme-scale systems

Journal Article · Wed May 25 20:00:00 EDT 2016 · Journal of Supercomputing · OSTI ID:1259429

Related Subjects

97 MATHEMATICS AND COMPUTING

A study of the viability of exploiting memory content similarity to improve resilience to memory errors

Citation Formats

References (38)

Similar Records

Related Subjects