LADR: low-cost application-level detector for reducing silent output corruptions

Chen, Chao; Eisenhauer, Greg; Wolf, Matthew D.; Pande, Santosh

doi:10.1145/3208040.3208043

LADR: low-cost application-level detector for reducing silent output corruptions

Conference · 01 June 2018

DOI:https://doi.org/10.1145/3208040.3208043· OSTI ID:1468063

Chen, Chao ^[1]; Eisenhauer, Greg ^[2]; ^[3]; Pande, Santosh ^[2]

Georgia Institute of Technology
Georgia Institute of Technology, Atlanta
ORNL

Applications running on future high performance computing (HPC) systems are more likely to experience transient faults due to technology scaling trends with respect to higher circuit density, smaller transistor size and near-threshold voltage (NTV) operations. A transient fault could corrupt application state without warning, possibly leading to incorrect application output. Such errors are called silent data corruptions (SDCs).In this paper, we present LADR, a low-cost application-level SDC detector for scientific applications. LADR protects scientific applications from SDCs by watching for data anomalies in their state variables (those of scientific interest). It employs compile-time data-flow analysis to minimize the number of monitored variables, thereby reducing runtime and memory overheads while maintaining a high level of fault coverage with low false positive rates. We evaluated LADR with 4 scientific workloads and results show that LADR achieved < 80% fault coverage with only ~ 3% runtime overheads and ~ 1% memory overheads. As compared to prior state-of-the-art anomaly-based detection methods, SDC achieved comparable or improved fault coverage, but reduced runtime overheads by 21% ~ 75%, and memory overheads by 35% ~ 55% for the evaluated workloads. We believe that such an approach with low memory and runtime overheads coupled with attractive detection precision makes LADR a viable approach for assuring the correct output from large-scale high performance simulations.

View Conference

Research Organization:: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1468063

Resource Relation:: Conference: International Symposium on High-Performance Parallel and Distributed Computing , New York, New York, June 11-15, 2018

Country of Publication:: United States

Language:: English

References (26)

Combining Partial Redundancy and Checkpointing for HPC No authors listed 2012 IEEE 32nd International Conference on Distributed Computing Systems (ICDCS) https://doi.org/10.1109/ICDCS.2012.56		June 2012
Classifying soft error vulnerabilities in extreme-Scale scientific applications using a binary instrumentation tool No authors listed 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.29		November 2012
SWIFT: Software Implemented Fault Tolerance No authors listed International Symposium on Code Generation and Optimization https://doi.org/10.1109/CGO.2005.34		January 2005
Software fault tolerance for FPUs via vectorization No authors listed 2015 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS) https://doi.org/10.1109/SAMOS.2015.7363677		July 2015
Failure Analysis of Virtual and Physical Machines: Patterns, Causes and Characteristics No authors listed 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) https://doi.org/10.1109/DSN.2014.18		June 2014
Lightweight Silent Data Corruption Detection Based on Runtime Data Analysis for HPC Applications No authors listed Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '15 https://doi.org/10.1145/2749246.2749253		January 2015
Experimental and analytical study of Xeon Phi reliability No authors listed Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '17 https://doi.org/10.1145/3126908.3126960		January 2017
Understanding the propagation of hard errors to software and implications for resilient system design No authors listed Proceedings of the 13th international conference on Architectural support for programming languages and operating systems - ASPLOS XIII https://doi.org/10.1145/1346281.1346315		January 2008
Understanding Soft Error Resiliency of Blue Gene/Q Compute Chip through Hardware Proton Irradiation and Software Fault Injection No authors listed SC14: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2014.53		November 2014
Online-ABFT: an online algorithm based fault tolerance scheme for soft error detection in iterative methods No authors listed Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming - PPoPP '13 https://doi.org/10.1145/2442516.2442533		January 2013
Hardware-Software Integrated Diagnosis for Intermittent Hardware Faults No authors listed 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) https://doi.org/10.1109/DSN.2014.1		June 2014
Transient-fault recovery for chip multiprocessors No authors listed Proceedings of the 30th annual international symposium on Computer architecture - ISCA '03 https://doi.org/10.1145/859618.859631		January 2003
Characterization of Impact of Transient Faults and Detection of Data Corruption Errors in Large-Scale N-Body Programs Using Graphics Processing Units No authors listed 2014 IEEE International Parallel & Distributed Processing Symposium (IPDPS), 2014 IEEE 28th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2014.55		May 2014
Fast Error-Bounded Lossy HPC Data Compression with SZ No authors listed 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2016.11		May 2016
FTI: high performance fault tolerance interface for hybrid systems No authors listed Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063427		January 2011
ACR: automatic checkpoint/restart for soft and hard error protection No authors listed Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13 https://doi.org/10.1145/2503210.2503266		January 2013
ED/sup 4/I: error detection by diverse data and duplicated instructions No authors listed IEEE Transactions on Computers https://doi.org/10.1109/12.980007		January 2002
Adaptive Impact-Driven Detection of Silent Data Corruption for HPC Applications No authors listed IEEE Transactions on Parallel and Distributed Systems https://doi.org/10.1109/TPDS.2016.2517639		October 2016
SIMD-based soft error detection No authors listed Proceedings of the ACM International Conference on Computing Frontiers - CF '16 https://doi.org/10.1145/2903150.2903170		January 2016
Evaluating the viability of process replication reliability for exascale systems No authors listed Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063443		January 2011
Algorithm-based fault tolerance for dense matrix factorizations No authors listed Proceedings of the 17th ACM SIGPLAN symposium on Principles and Practice of Parallel Programming - PPoPP '12 https://doi.org/10.1145/2145816.2145845		January 2012
Algorithm-based recovery for iterative methods without checkpointing No authors listed Proceedings of the 20th international symposium on High performance distributed computing - HPDC '11 https://doi.org/10.1145/1996130.1996142		January 2011
Hauberk: Lightweight Silent Data Corruption Error Detector for GPGPU No authors listed Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.36		May 2011
NUMARCK: Machine Learning Algorithm for Resiliency and Checkpointing No authors listed SC14: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2014.65		November 2014
Detecting and Correcting Data Corruption in Stencil Applications through Multivariate Interpolation No authors listed 2015 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2015.108		September 2015
Correcting soft errors online in LU factorization No authors listed Proceedings of the 22nd international symposium on High-performance parallel and distributed computing - HPDC '13 https://doi.org/10.1145/2493123.2462920		January 2013

Similar Records

An Efficient Silent Data Corruption Detection Method with Error-Feedback Control and Even Sampling for HPC Applications

Conference · 2015 · OSTI ID:1335909

Di, Sheng; Berrocal, Eduardo; Cappello, Franck

Adaptive Impact-Driven Detection of Silent Data Corruption for HPC Applications

Journal Article · 2016 · IEEE Transactions on Parallel and Distributed Systems · OSTI ID:1391750

Di, Sheng; Cappello, Franck

MACORD: Online Adaptive Machine Learning Framework for Silent Error Detection

Conference · 2017 · OSTI ID:1526315

Subasi, Omer; Di, Sheng; Balaprakash, Prasanna; +5 more

LADR: low-cost application-level detector for reducing silent output corruptions

Citation Formats

References (26)

Similar Records

Related Subjects