Statistical Hypothesis Testing using CNN Features for Synthesis of Adversarial Counterexamples to Human and Object Detection Vision Systems
- Univ. of Central Florida, Orlando, FL (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Validating the correctness of human detection vision systems is crucial for safety applications such as pedestrian collision avoidance in autonomous vehicles. The enormous space of possible inputs to such an intelligent system makes it difficult to design test cases for such systems. In this report, we present our tool MAYA that uses an error model derived from a convolutional neural network (CNN) to explore the space of images similar to a given input image, and then tests the correctness of a given human or object detection system on such perturbed images. We demonstrate the capability of our tool on the pre-trained Histogram-of-Oriented-Gradients (HOG) human detection algorithm implemented in the popular OpenCV toolset and the Caffe object detection system pre-trained on the ImageNet benchmark. Our tool may serve as a testing resource for the designers of intelligent human and object detection systems.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1361358
- Report Number(s):
- ORNL/LTR--2017/118; 45304036B
- Country of Publication:
- United States
- Language:
- English
Similar Records
Integrating Symbolic and Statistical Methods for Testing Intelligent Systems Applications to Machine Learning and Computer Vision
Testing autonomous cyber-physical systems using fuzzing features from convolutional neural networks: work-in-progress
REMODEL: Rethinking Deep CNN Models to Detect and Count on a NeuroSynaptic System
Conference
·
Thu Dec 31 23:00:00 EST 2015
·
OSTI ID:1311305
Testing autonomous cyber-physical systems using fuzzing features from convolutional neural networks: work-in-progress
Conference
·
Wed Nov 01 00:00:00 EDT 2017
·
OSTI ID:1474696
REMODEL: Rethinking Deep CNN Models to Detect and Count on a NeuroSynaptic System
Journal Article
·
Thu Feb 21 19:00:00 EST 2019
· Frontiers in Neuroscience (Online)
·
OSTI ID:2375413