Statistical Hypothesis Testing using CNN Features for Synthesis of Adversarial Counterexamples to Human and Object Detection Vision Systems
- Univ. of Central Florida, Orlando, FL (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Validating the correctness of human detection vision systems is crucial for safety applications such as pedestrian collision avoidance in autonomous vehicles. The enormous space of possible inputs to such an intelligent system makes it difficult to design test cases for such systems. In this report, we present our tool MAYA that uses an error model derived from a convolutional neural network (CNN) to explore the space of images similar to a given input image, and then tests the correctness of a given human or object detection system on such perturbed images. We demonstrate the capability of our tool on the pre-trained Histogram-of-Oriented-Gradients (HOG) human detection algorithm implemented in the popular OpenCV toolset and the Caffe object detection system pre-trained on the ImageNet benchmark. Our tool may serve as a testing resource for the designers of intelligent human and object detection systems.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1361358
- Report Number(s):
- ORNL/LTR-2017/118; 45304036B
- Country of Publication:
- United States
- Language:
- English
Similar Records
Testing autonomous cyber-physical systems using fuzzing features from convolutional neural networks: work-in-progress
PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)