DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Selecting Post-Processing Schemes for Accurate Detection of Small Objects in Low-Resolution Wide-Area Aerial Imagery

Journal Article · · Remote Sensing
DOI: https://doi.org/10.3390/rs14020255 · OSTI ID:1981179
ORCiD logo [1]; ORCiD logo [2];  [3];  [4];  [5]; ORCiD logo [4];  [4];  [6];  [4]
  1. University of Arizona, Tucson, AZ (United States); Univ. of Arizona, Tucson, AZ (United States)
  2. University of Michigan, Ann Arbor, MI (United States)
  3. Genetesis, Mason, OH (United States)
  4. University of Arizona, Tucson, AZ (United States)
  5. Fraunhofer USA Center Mid-Atlantic (CMA), Riverdale, MD (United States)
  6. Universidad de Sonora, Hermosillo (Mexico)

In low-resolution wide-area aerial imagery, object detection algorithms are categorized as feature extraction and machine learning approaches, where the former often requires a post-processing scheme to reduce false detections and the latter demands multi-stage learning followed by post-processing. In this paper, we present an approach on how to select post-processing schemes for aerial object detection. We evaluated combinations of each of ten vehicle detection algorithms with any of seven post-processing schemes, where the best three schemes for each algorithm were determined using average F-score metric. The performance improvement is quantified using basic information retrieval metrics as well as the classification of events, activities and relationships (CLEAR) metrics. We also implemented a two-stage learning algorithm using a hundred-layer densely connected convolutional neural network for small object detection and evaluated its degree of improvement when combined with the various post-processing schemes. The highest average F-scores after post-processing are 0.902, 0.704 and 0.891 for the Tucson, Phoenix and online VEDAI datasets, respectively. The combined results prove that our enhanced three-stage post-processing scheme achieves a mean average precision (mAP) of 63.9% for feature extraction methods and 82.8% for the machine learning approach.

Research Organization:
University of Arizona, Tucson, AZ (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA); Air Force Office of Scientific Research (AFOSR); National Science Foundation (NSF); National Institute of Standards and Technology (NIST)
Grant/Contract Number:
NA0003946
OSTI ID:
1981179
Journal Information:
Remote Sensing, Journal Name: Remote Sensing Journal Issue: 2 Vol. 14; ISSN 2072-4292
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English

References (79)

An explainable and efficient deep learning framework for video anomaly detection journal November 2021
Impact of compressed and down-scaled training images on vehicle detection in remote sensing imagery journal August 2019
Performance evaluation of automatic object detection with post-processing schemes under enhanced measures in wide-area aerial imagery journal August 2020
Smoke vehicle detection based on multi-feature fusion and hidden Markov model journal February 2019
Sparse representation-based hyperspectral image classification journal February 2018
A post-processing scheme for the performance improvement of vehicle detection in wide-area aerial imagery journal November 2019
Brain MRI segmentation using KFCM and Chan-Vese model journal June 2011
Accurate subpixel edge location based on partial area effect journal January 2013
Recent advances in small object detection based on deep learning: A review journal May 2020
Vehicle detection of multi-source remote sensing data using active fine-tuning network journal September 2020
Vehicle detection in aerial imagery : A small target detection benchmark journal January 2016
Object detection by spatio-temporal analysis and tracking of the detected objects in a video with variable background journal January 2019
Image thresholding by variational minimax optimization journal May 2009
Deep morphological networks journal June 2020
STDnet-ST: Spatio-temporal ConvNet for small object detection journal August 2021
A method of cross-layer fusion multi-object detection and recognition based on improved faster R-CNN model in complex traffic environment journal May 2021
Orientation aware vehicle detection in aerial images journal October 2017
Vehicle detection in aerial images based on lightweight deep convolutional network journal December 2020
Moving vehicle detection in aerial infrared image sequences via fast image registration and improved YOLOv3 network journal February 2020
Tiny moving vehicle detection in satellite video with constraints of multiple prior information journal March 2021
Salient object detection in hyperspectral images using deep background reconstruction based anomaly detection journal November 2021
Vehicle Detection and Counting in High-Resolution Aerial Images Using Convolutional Regression Neural Network journal January 2018
Effective Contexts for UAV Vehicle Detection journal January 2019
A Survey of Deep Learning-Based Object Detection journal January 2019
Object Recognition in Very Low Resolution Images Using Deep Collaborative Learning journal January 2019
Vehicle Detection in Aerial Images Based on Lightweight Deep Convolutional Network and Generative Adversarial Network journal January 2019
Joint-SRVDNet: Joint Super Resolution and Vehicle Detection Network journal January 2020
Small-Object Detection in UAV-Captured Images via Multi-Branch Parallel Feature Pyramid Networks journal January 2020
Spatio-Temporal Processing for Automatic Vehicle Detection in Wide-Area Aerial Video journal January 2020
A Novel Vehicle Detection Method With High Resolution Highway Aerial Image journal December 2013
Detection of Vehicles in Multisensor Data via Multibranch Convolutional Neural Networks journal November 2018
Cross-Layer Attention Network for Small Object Detection in Remote Sensing Imagery journal January 2021
DE-CycleGAN: An Object Enhancement Network for Weak Vehicle Detection in Satellite Images journal January 2021
Semantic Segmentation of Aerial Images With Shuffling Convolutional Neural Networks journal February 2018
Wide-Area Motion Imagery journal September 2010
Car Detection in Aerial Images of Dense Urban Areas journal February 2018
Mixed Noise Removal via Robust Constrained Sparse Representation journal September 2018
Comprehensive Analysis of Deep Learning-Based Vehicle Detection in Aerial Images journal September 2019
Smoke Vehicle Detection Based on Spatiotemporal Bag-Of-Features and Professional Convolutional Neural Network journal October 2020
Aggregating Attentional Dilated Features for Salient Object Detection journal October 2020
Dense and Sparse Reconstruction Error Based Saliency Descriptor journal April 2016
Salient Object Detection via Multiple Instance Learning journal April 2017
Foreground Gating and Background Refining Network for Surveillance Object Detection journal December 2019
Hierarchical and Interactive Refinement Network for Edge-Preserving Salient Object Detection journal January 2021
Sequential Instance Refinement for Cross-Domain Object Detection in Images journal January 2021
Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis journal December 2013
Performance evaluation of object detection algorithms for video surveillance journal August 2006
Hierarchical Context Features Embedding for Object Detection journal December 2020
Object Detection With Deep Learning: A Review journal November 2019
Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol journal February 2009
Deep Learning for 3D Point Clouds: A Survey journal December 2021
Concealed Object Detection journal October 2022
A Survey of the Four Pillars for Small Object Detection: Multiscale Representation, Contextual Information, Super-Resolution, and Region Proposal journal February 2022
Intelligent Intersection journal February 2020
An Ensemble of Ensembles Approach to Author Attribution for Internet Relay Chat Forensics journal October 2020
Object Detection Using Deep Learning Methods in Traffic Scenarios journal March 2021
Fusion Based FastICA Method: Facial Expression Recognition journal January 2014
Vehicle detection in wide-area aerial imagery: cross-association of detection schemes with post-processings journal January 2018
A thresholding scheme of eliminating false detections on vehicles in wide-area aerial imagery journal January 2018
Deep Learning Segmentation and 3D Reconstruction of Road Markings Using Multiview Aerial Imagery journal January 2019
Affine-Function Transformation-Based Object Matching for Vehicle Detection from Unmanned Aerial Vehicle Imagery journal July 2019
Multiple-Oriented and Small Object Detection with Convolutional Neural Networks for Aerial Image journal September 2019
Local Region Proposing for Frame-Based Vehicle Detection in Satellite Videos journal October 2019
Small-Object Detection in Remote Sensing Images with End-to-End Edge-Enhanced GAN and Object Detector Network journal May 2020
Single-Stage Rotation-Decoupled Detector for Oriented Object journal October 2020
Comparative Monte Carlo Analysis of Background Estimation Algorithms for Unmanned Aerial Vehicle Detection journal February 2021
FSRSS-Net: High-Resolution Mapping of Buildings from Middle-Resolution Satellite Images Using a Super-Resolution Semantic Segmentation Network journal June 2021
From Point to Region: Accurate and Efficient Hierarchical Small Object Detection in Low-Resolution Remote Sensing Images journal July 2021
Sparse Label Assignment for Oriented Object Detection in Aerial Images journal July 2021
Elongated Small Object Detection from Remote Sensing Images Using Hierarchical Scale-Sensitive Networks journal August 2021
Improving YOLOv5 with Attention Mechanism for Detecting Boulders from Planetary Images journal September 2021
EFM-Net: Feature Extraction and Filtration with Mask Improvement Network for Object Detection in Remote Sensing Images journal October 2021
An Approach to Semantically Segmenting Building Components and Outdoor Scenes Based on Multichannel Aerial Imagery Datasets journal October 2021
Vehicle Counting Based on Vehicle Detection and Tracking from Aerial Videos journal August 2018
Front-Vehicle Detection in Video Images Based on Temporal and Spatial Characteristics journal April 2019
Vehicle Detection in Aerial Images Using a Fast Oriented Region Search and the Vector of Locally Aggregated Descriptors journal July 2019
Real-Time Vehicle-Detection Method in Bird-View Unmanned-Aerial-Vehicle Imagery journal September 2019
An Improved FBPN-Based Detection Network for Vehicles in Aerial Images journal August 2020
The Automated Vehicle Detection of Highway Traffic Images by Differential Morphological Profile journal January 2014