FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

Das, Arnab; Krishnamoorthy, Sriram; Briggs, Ian; Gopalakrishnan, Ganesh; Tipireddy, Ramakrishna

doi:10.1145/3402451

Title: FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

Journal Article · 20 August 2020 · ACM Transactions on Architecture and Code Optimization

DOI: https://doi.org/10.1145/3402451 · OSTI ID:1673584

Das, Arnab ^[1]; Krishnamoorthy, Sriram ^[2]; Briggs, Ian ^[1]; Gopalakrishnan, Ganesh ^[1];

^[2]

Univ. of Utah, Salt Lake City, UT (United States)
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)

We present FPDetect, a low-overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF)

Grant/Contract Number:: AC05-76RL01830

OSTI ID:: 1673584

Report Number(s):: PNNL-SA--153397; {"","Journal ID: ISSN 1544-3566"}

Journal Information:: ACM Transactions on Architecture and Code Optimization, Journal Name: ACM Transactions on Architecture and Code Optimization Journal Issue: 3 Vol. 17; ISSN 1544-3566

Publisher:: Association for Computing MachineryCopyright Statement

Country of Publication:: United States

Language:: English

References (31)

Error Tolerance in Server Class Processors Rivers, Jude A.; Gupta, Meeta S.; Shin, Jeonghee IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 30, Issue 7 https://doi.org/10.1109/TCAD.2011.2158100	journal	July 2011
Equivalence checking of static affine programs using widening to handle recurrences Verdoolaege, Sven; Janssens, Gerda; Bruynooghe, Maurice ACM Transactions on Programming Languages and Systems, Vol. 34, Issue 3 https://doi.org/10.1145/2362389.2362390	journal	October 2012
Rigorous floating-point mixed-precision tuning Chiang, Wei-Fan; Baranowski, Mark; Briggs, Ian Proceedings of the 44th ACM SIGPLAN Symposium on Principles of Programming Languages - POPL 2017 https://doi.org/10.1145/3009837.3009846	conference	January 2017
Silent Data Corruption Resilient Two-sided Matrix Factorizations Wu, Panruo; DeBardeleben, Nathan; Guan, Qiang PPoPP '17: 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming https://doi.org/10.1145/3018743.3018750	conference	January 2017
New-Sum: A Novel Online ABFT Scheme For General Iterative Methods Tao, Dingwen; Song, Shuaiwen Leon; Krishnamoorthy, Sriram Proceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing - HPDC '16 https://doi.org/10.1145/2907294.2907306	conference	January 2016
Evaluating the Impact of SDC on the GMRES Iterative Solver Elliott, James; Hoemmen, Mark; Mueller, Frank 2014 IEEE International Parallel & Distributed Processing Symposium (IPDPS), 2014 IEEE 28th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2014.123	conference	May 2014
A Numerical Soft Fault Model for Iterative Linear Solvers Elliott, James; Hoemmen, Mark; Mueller, Frank Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '15 https://doi.org/10.1145/2749246.2749254	conference	January 2015
Formal Verification of Floating-Point Programs Boldo, Sylvie; Filliatre, Jean-Christophe 18th IEEE Symposium on Computer Arithmetic (ARITH '07) https://doi.org/10.1109/ARITH.2007.20	conference	June 2007
Algorithm-Based Fault Tolerance for Matrix Operations IEEE Transactions on Computers, Vol. C-33, Issue 6 https://doi.org/10.1109/TC.1984.1676475	journal	June 1984
Rigorous Estimation of Floating-Point Round-Off Errors with Symbolic Taylor Expansions Solovyev, Alexey; Baranowski, Marek S.; Briggs, Ian ACM Transactions on Programming Languages and Systems, Vol. 41, Issue 1 https://doi.org/10.1145/3230733	journal	March 2019
Proofs of numerical programs when the compiler optimizes Boldo, Sylvie; Nguyen, Thi Minh Tuyen Innovations in Systems and Software Engineering, Vol. 7, Issue 2 https://doi.org/10.1007/s11334-011-0151-6	journal	March 2011
GS-DMR: Low-overhead soft error detection scheme for stencil-based computation Xiaoguang, Ren; Xinhai, Xu; Qian, Wang Parallel Computing, Vol. 41 https://doi.org/10.1016/j.parco.2014.11.003	journal	January 2015
A Survey on Post-Silicon Functional Validation for Multicore Architectures Jayaraman, Padma; Parthasarathi, Ranjani ACM Computing Surveys, Vol. 50, Issue 4 https://doi.org/10.1145/3107615	journal	November 2017
FT-ScaLAPACK: correcting soft errors on-line for ScaLAPACK cholesky, QR, and LU factorization routines Wu, Panruo; Chen, Zizhong Proceedings of the 23rd international symposium on High-performance parallel and distributed computing - HPDC '14 https://doi.org/10.1145/2600212.2600232	conference	January 2014
A new golden age for computer architecture Hennessy, John L.; Patterson, David A. Communications of the ACM, Vol. 62, Issue 2 https://doi.org/10.1145/3282307	journal	January 2019
Adaptive Impact-Driven Detection of Silent Data Corruption for HPC Applications Di, Sheng; Cappello, Franck IEEE Transactions on Parallel and Distributed Systems, Vol. 27, Issue 10 https://doi.org/10.1109/TPDS.2016.2517639	journal	October 2016
Exploiting data representation for fault tolerance Elliott, J.; Hoemmen, M.; Mueller, F. Journal of Computational Science, Vol. 14 https://doi.org/10.1016/j.jocs.2015.12.002	journal	May 2016
Certified Roundoff Error Bounds Using Semidefinite Programming Magron, Victor; Constantinides, George; Donaldson, Alastair ACM Transactions on Mathematical Software, Vol. 43, Issue 4 https://doi.org/10.1145/3015465	journal	March 2017
What every computer scientist should know about floating-point arithmetic Goldberg, David ACM Computing Surveys, Vol. 23, Issue 1 https://doi.org/10.1145/103162.103163	journal	March 1991
Spatial Support Vector Regression to Detect Silent Errors in the Exascale Era Subasi, Omer; Di, Sheng; Bautista-Gomez, Leonardo 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) https://doi.org/10.1109/CCGrid.2016.33	conference	May 2016
Clover: Compiler Directed Lightweight Soft Error Resilience Liu, Qingrui; Jung, Changhee; Lee, Dongyoon ACM SIGPLAN Notices, Vol. 50, Issue 5 https://doi.org/10.1145/2808704.2754959	journal	July 2015
Reliability lessons learned from GPU experience with the Titan supercomputer at Oak Ridge leadership computing facility Tiwari, Devesh; Gupta, Saurabh; Gallarno, George Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807666	conference	January 2015
A priori worst-case error bounds for floating-point computations Kramer, W. Proceedings 13th IEEE Sympsoium on Computer Arithmetic https://doi.org/10.1109/ARITH.1997.614880	conference	January 1997
Towards a Compiler for Reals Darulova, Eva; Kuncak, Viktor ACM Transactions on Programming Languages and Systems, Vol. 39, Issue 2 https://doi.org/10.1145/3014426	journal	May 2017
A Gaussian Process Approach for Effective Soft Error Detection Subasi, Omer; Krishnamoorthy, Sriram 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.129	conference	September 2017
Comparative analysis of soft-error detection strategies: a case study with iterative methods Kestor, Gokcen; Mutlu, Burcu Ozcelik; Manzano, Joseph CF '18: Computing Frontiers Conference, Proceedings of the 15th ACM International Conference on Computing Frontiers https://doi.org/10.1145/3203217.3203240	conference	May 2018
MACORD: Online Adaptive Machine Learning Framework for Silent Error Detection Subasi, Omer; Di, Sheng; Balaprakash, Prasanna 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.128	conference	September 2017
Affine Arithmetic: Concepts and Applications de Figueiredo, Luiz Henrique; Stolfi, Jorge Numerical Algorithms, Vol. 37, Issue 1-4 https://doi.org/10.1023/B:NUMA.0000049462.70970.b6	journal	December 2004
Tolerating Soft Errors in Processor Cores Using CLEAR (Cross-Layer Exploration for Architecting Resilience) Cheng, Eric; Mirkhani, Shahrzad; Szafaryn, Lukasz G. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 37, Issue 9 https://doi.org/10.1109/TCAD.2017.2752705	journal	September 2018
Soft Errors in Advanced Computer Systems Baumann, R. IEEE Design and Test of Computers, Vol. 22, Issue 3 https://doi.org/10.1109/MDT.2005.69	journal	May 2005
Sound compilation of reals Darulova, Eva; Kuncak, Viktor Proceedings of the 41st ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages - POPL '14 https://doi.org/10.1145/2535838.2535874	conference	January 2014

Similar Records

Detecting Soft Errors in Stencil based Computations

Technical Report · 2015 · OSTI ID:1184174

Sharma, V.; Gopalkrishnan, G.; Bronevetsky, G.

Panda: A Compiler Framework for Concurrent CPU $+$ GPU Execution of 3D Stencil Computations on GPU-accelerated Supercomputers

Journal Article · 2016 · International Journal of Parallel Programming · OSTI ID:1525220

Sourouri, Mohammed; Baden, Scott B.; Cai, Xing

PIMS: A Lightweight Processing-in-Memory Accelerator for Stencil Computations

Conference · 2019 · OSTI ID:1579729

Li, Jie; Xi, Wang; Tumeo, Antonino; +3 more

Related Subjects

97
fault tolerance
stencil programs
soft-error detection
floating-point analysis
error detection and error correction
computer systems organization
reliability
software and its engineering
software verification
mathematics of computing
numerical analysis
floating point round-off error
stencil computations
affine analysis
interval analysis
silent data corruption
software bug detection

Title: FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

Citation Formats

References (31)

Similar Records

Related Subjects