Architecture-Preserving Provable Repair of Deep Neural Networks

Journal Article · 06 June 2023 · Proceedings of the ACM on Programming Languages

DOI: https://doi.org/10.1145/3591238 · OSTI ID:1975934

Tao, Zhe  ^[1]; Nawas, Stephanie  ^[1]; Mitchell, Jacqueline  ^[1]; Thakur, Aditya V.  ^[1]

---

1. Univ. of California, Davis, CA (United States)

Deep neural networks (DNNs) are becoming increasingly important components of software, and are considered the state-of-the-art solution for a number of problems, such as image recognition. However, DNNs are far from infallible, and incorrect behavior of DNNs can have disastrous real-world consequences. This paper addresses the problem of architecture-preserving V-polytope provable repair of DNNs. A V-polytope defines a convex bounded polytope using its vertex representation. V-polytope provable repair guarantees that the repaired DNN satisfies the given specification on the infinite set of points in the given V-polytope. An architecture-preserving repair only modifies the parameters of the DNN, without modifying its architecture. The repair has the flexibility to modify multiple layers of the DNN, and runs in polynomial time. It supports DNNs with activation functions that have some linear pieces, as well as fully-connected, convolutional, pooling and residual layers. To the best our knowledge, this is the first provable repair approach that has all of these features. We implement our approach in a tool called APRNN. Using MNIST, ImageNet, and ACAS Xu DNNs, we show that it has better efficiency, scalability, and generalization compared to PRDNN and REASSURE, prior provable repair methods that are not architecture preserving.

• Research Organization: Univ. of California, Davis, CA (United States)
• Sponsoring Organization: USDOE Office of Science (SC); National Science Foundation (NSF)
• Grant/Contract Number: SC0022285; CCF-2048123
• OSTI ID: 1975934
• Journal Information: Proceedings of the ACM on Programming Languages, Vol. 7, Issue PLDI; Related Information: Associated open-source software: https://github.com/95616ARG/APRNN; ISSN 2475-1421
• Publisher: Association for Computing Machinery (ACM)Copyright Statement
• Country of Publication: United States
• Language: English