skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery

Journal Article · · Remote Sensing
DOI:https://doi.org/10.3390/rs8100796· OSTI ID:1362128
 [1]; ORCiD logo [2];  [1];  [1];  [1];  [1]
  1. Purdue Univ., West Lafayette, IN (United States)
  2. Purdue Univ., West Lafayette, IN (United States); Kyungpook National Univ., Sangju (Korea)

Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INS navigation data for accurate geometric rectification of the hyperspectral scenes. The approach relies on utilizing the navigation data, together with a modified Speeded-Up Robust Feature (SURF) detector and descriptor, for automating the identification of conjugate features in the RGB and hyperspectral imagery. The SURF modification takes into consideration the available direct geo-referencing information to improve the reliability of the matching procedure in the presence of repetitive texture within a mechanized agricultural field. Identified features are then used to improve the geometric fidelity of the previously ortho-rectified hyperspectral data. Lastly, experimental results from two real datasets show that the geometric rectification of the hyperspectral data was improved by almost one order of magnitude.

Research Organization:
Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
Sponsoring Organization:
USDOE
Grant/Contract Number:
AR0000593
OSTI ID:
1362128
Journal Information:
Remote Sensing, Vol. 8, Issue 10; ISSN 2072-4292
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 38 works
Citation information provided by
Web of Science

References (36)

Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images journal April 2015
Future Scenarios for Plant Phenotyping journal April 2013
BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding journal February 2013
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras journal January 2017
The application of small unmanned aerial systems for precision agriculture: a review journal July 2012
Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture journal October 2013
Towards the Development of a Smart Flying Sensor: Illustration in the Field of Precision Agriculture journal July 2015
Field high-throughput phenotyping: the new crop breeding frontier journal January 2014
Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance journal October 2015
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer journal January 2015
Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping journal July 2014
Calibration of a Pushbroom Hyperspectral Imaging System for Agricultural Inspection journal January 2003
Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements journal November 2012
Remote sensing of sagebrush canopy nitrogen journal September 2012
Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle journal March 2009
Bundle Adjustment with Self–Calibration Using Straight Lines journal October 2002
Uav Photogrammetry for Mapping and 3d Modeling – Current Status and Future Perspectives journal January 2011
A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles journal November 2014
Low-altitude Terrestrial Spectroscopy from a Pushbroom Sensor: Low-Altitude Terrestrial Spectroscopy journal October 2015
Distinctive Image Features from Scale-Invariant Keypoints journal November 2004
Speeded-Up Robust Features (SURF) journal June 2008
Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images journal November 2011
Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas journal September 2014
Multilevel SIFT Matching for Large-Size VHR Image Registration journal March 2012
A robust multisource image automatic registration system based on the SIFT descriptor journal December 2011
A fast and fully automatic registration approach based on point features for multi-source remote-sensing images journal July 2008
Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT journal July 2013
Automatic Registration of High-Resolution Images Using Local Properties of Features journal March 2012
A Robust Image Matching Method based on Optimized BaySAC journal November 2014
Automatic and accurate registration of VHR optical and SAR images using a quadtree structure journal April 2015
A Fast and Reliable Matching Method for Automated Georeferencing of Remotely-Sensed Imagery journal January 2016
Feature-Area Optimization: A Novel SAR Image Registration Method journal February 2016
Robust regression methods for computer vision: A review journal April 1991
Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems journal January 2014
Rapid and low-cost insect detection for analysing species trapped on yellow sticky traps journal May 2021
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer text January 2015

Cited By (11)

Comparison of leaf area index inversion for grassland vegetation through remotely sensed spectra by unmanned aerial vehicle and field-based spectroradiometer journal September 2018
Automated Coregistration of Multisensor Orthophotos Generated from Unmanned Aerial Vehicle Platforms journal April 2019
Implementation of a UAV–Hyperspectral Pushbroom Imager for Ecological Monitoring journal January 2019
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows journal July 2018
Automated Aerial Triangulation for UAV-Based Mapping journal December 2018
A Simulation Environment for Validation and Verification of Real Time Hyperspectral Processing Algorithms on-Board a UAV journal August 2019
An Under-Ice Hyperspectral and RGB Imaging System to Capture Fine-Scale Biophysical Properties of Sea Ice journal December 2019
The DOM Generation and Precise Radiometric Calibration of a UAV-Mounted Miniature Snapshot Hyperspectral Imager journal June 2017
Intercomparison of Unmanned Aerial Vehicle and Ground-Based Narrow Band Spectrometers Applied to Crop Trait Monitoring in Organic Potato Production journal June 2017
Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery journal May 2018
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows text January 2018