Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery

Journal Article · · Remote Sensing
DOI:https://doi.org/10.3390/rs8100796· OSTI ID:1362128
 [1];  [2];  [3];  [3];  [3];  [3]
  1. Purdue Univ., West Lafayette, IN (United States); Lyles School of Civil Engineering, Purdue University, West Lafayette, IN 47907, USA
  2. Purdue Univ., West Lafayette, IN (United States); Kyungpook National Univ., Sangju (Korea)
  3. Purdue Univ., West Lafayette, IN (United States)
Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INS navigation data for accurate geometric rectification of the hyperspectral scenes. The approach relies on utilizing the navigation data, together with a modified Speeded-Up Robust Feature (SURF) detector and descriptor, for automating the identification of conjugate features in the RGB and hyperspectral imagery. The SURF modification takes into consideration the available direct geo-referencing information to improve the reliability of the matching procedure in the presence of repetitive texture within a mechanized agricultural field. Identified features are then used to improve the geometric fidelity of the previously ortho-rectified hyperspectral data. Lastly, experimental results from two real datasets show that the geometric rectification of the hyperspectral data was improved by almost one order of magnitude.
Research Organization:
Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
Sponsoring Organization:
USDOE
Grant/Contract Number:
AR0000593
OSTI ID:
1362128
Journal Information:
Remote Sensing, Journal Name: Remote Sensing Journal Issue: 10 Vol. 8; ISSN 2072-4292
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English

References (36)

Low-altitude Terrestrial Spectroscopy from a Pushbroom Sensor: Low-Altitude Terrestrial Spectroscopy journal October 2015
Robust regression methods for computer vision: A review journal April 1991
The application of small unmanned aerial systems for precision agriculture: a review journal July 2012
A fast and fully automatic registration approach based on point features for multi-source remote-sensing images journal July 2008
Speeded-Up Robust Features (SURF) journal June 2008
Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance journal October 2015
Remote sensing of sagebrush canopy nitrogen journal September 2012
Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements journal November 2012
Field high-throughput phenotyping: the new crop breeding frontier journal January 2014
Distinctive Image Features from Scale-Invariant Keypoints journal November 2004
Rapid and low-cost insect detection for analysing species trapped on yellow sticky traps journal May 2021
A robust multisource image automatic registration system based on the SIFT descriptor journal December 2011
Automatic and accurate registration of VHR optical and SAR images using a quadtree structure journal April 2015
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras journal January 2017
Multilevel SIFT Matching for Large-Size VHR Image Registration journal March 2012
Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT journal July 2013
Feature-Area Optimization: A Novel SAR Image Registration Method journal February 2016
Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle journal March 2009
Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images journal November 2011
Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas journal September 2014
Bundle Adjustment with Self–Calibration Using Straight Lines journal October 2002
Future Scenarios for Plant Phenotyping journal April 2013
Calibration of a Pushbroom Hyperspectral Imaging System for Agricultural Inspection journal January 2003
Automatic Registration of High-Resolution Images Using Local Properties of Features journal March 2012
A Robust Image Matching Method based on Optimized BaySAC journal November 2014
Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping journal July 2014
Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture journal October 2013
A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles journal November 2014
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer journal January 2015
Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images journal April 2015
A Fast and Reliable Matching Method for Automated Georeferencing of Remotely-Sensed Imagery journal January 2016
BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding journal February 2013
Towards the Development of a Smart Flying Sensor: Illustration in the Field of Precision Agriculture journal July 2015
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer text January 2015
Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems journal January 2014
Uav Photogrammetry for Mapping and 3d Modeling – Current Status and Future Perspectives journal January 2011

Cited By (11)

Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery journal May 2018
Comparison of leaf area index inversion for grassland vegetation through remotely sensed spectra by unmanned aerial vehicle and field-based spectroradiometer journal September 2018
Automated Coregistration of Multisensor Orthophotos Generated from Unmanned Aerial Vehicle Platforms journal April 2019
Implementation of a UAV–Hyperspectral Pushbroom Imager for Ecological Monitoring journal January 2019
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows journal July 2018
Automated Aerial Triangulation for UAV-Based Mapping journal December 2018
A Simulation Environment for Validation and Verification of Real Time Hyperspectral Processing Algorithms on-Board a UAV journal August 2019
An Under-Ice Hyperspectral and RGB Imaging System to Capture Fine-Scale Biophysical Properties of Sea Ice journal December 2019
The DOM Generation and Precise Radiometric Calibration of a UAV-Mounted Miniature Snapshot Hyperspectral Imager journal June 2017
Intercomparison of Unmanned Aerial Vehicle and Ground-Based Narrow Band Spectrometers Applied to Crop Trait Monitoring in Organic Potato Production journal June 2017
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows text January 2018