DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery

Abstract

Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INSmore » navigation data for accurate geometric rectification of the hyperspectral scenes. The approach relies on utilizing the navigation data, together with a modified Speeded-Up Robust Feature (SURF) detector and descriptor, for automating the identification of conjugate features in the RGB and hyperspectral imagery. The SURF modification takes into consideration the available direct geo-referencing information to improve the reliability of the matching procedure in the presence of repetitive texture within a mechanized agricultural field. Identified features are then used to improve the geometric fidelity of the previously ortho-rectified hyperspectral data. Lastly, experimental results from two real datasets show that the geometric rectification of the hyperspectral data was improved by almost one order of magnitude.« less

Authors:
 [1]; ORCiD logo [2];  [1];  [1];  [1];  [1]
  1. Purdue Univ., West Lafayette, IN (United States)
  2. Purdue Univ., West Lafayette, IN (United States); Kyungpook National Univ., Sangju (Korea)
Publication Date:
Research Org.:
Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
Sponsoring Org.:
USDOE
OSTI Identifier:
1362128
Grant/Contract Number:  
AR0000593
Resource Type:
Accepted Manuscript
Journal Name:
Remote Sensing
Additional Journal Information:
Journal Volume: 8; Journal Issue: 10; Journal ID: ISSN 2072-4292
Publisher:
MDPI
Country of Publication:
United States
Language:
English
Subject:
47 OTHER INSTRUMENTATION; 60 APPLIED LIFE SCIENCES; automated image registration; ortho-rectification; hyperspectral push-broom scanners; phenotyping; SURF; UAV-based agricultural management

Citation Formats

Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, and Crawford, Melba. Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery. United States: N. p., 2016. Web. doi:10.3390/rs8100796.
Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, & Crawford, Melba. Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery. United States. https://doi.org/10.3390/rs8100796
Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, and Crawford, Melba. Sat . "Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery". United States. https://doi.org/10.3390/rs8100796. https://www.osti.gov/servlets/purl/1362128.
@article{osti_1362128,
title = {Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery},
author = {Habib, Ayman and Han, Youkyung and Xiong, Weifeng and He, Fangning and Zhang, Zhou and Crawford, Melba},
abstractNote = {Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INS navigation data for accurate geometric rectification of the hyperspectral scenes. The approach relies on utilizing the navigation data, together with a modified Speeded-Up Robust Feature (SURF) detector and descriptor, for automating the identification of conjugate features in the RGB and hyperspectral imagery. The SURF modification takes into consideration the available direct geo-referencing information to improve the reliability of the matching procedure in the presence of repetitive texture within a mechanized agricultural field. Identified features are then used to improve the geometric fidelity of the previously ortho-rectified hyperspectral data. Lastly, experimental results from two real datasets show that the geometric rectification of the hyperspectral data was improved by almost one order of magnitude.},
doi = {10.3390/rs8100796},
journal = {Remote Sensing},
number = 10,
volume = 8,
place = {United States},
year = {Sat Sep 24 00:00:00 EDT 2016},
month = {Sat Sep 24 00:00:00 EDT 2016}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 38 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images
journal, April 2015

  • Candiago, Sebastian; Remondino, Fabio; De Giglio, Michaela
  • Remote Sensing, Vol. 7, Issue 4
  • DOI: 10.3390/rs70404026

Future Scenarios for Plant Phenotyping
journal, April 2013


BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding
journal, February 2013

  • Busemeyer, Lucas; Mentrup, Daniel; Möller, Kim
  • Sensors, Vol. 13, Issue 3
  • DOI: 10.3390/s130302830

Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras
journal, January 2017

  • Habib, Ayman; Xiong, Weifeng; He, Fangning
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, Issue 1
  • DOI: 10.1109/JSTARS.2016.2520929

The application of small unmanned aerial systems for precision agriculture: a review
journal, July 2012


Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture
journal, October 2013

  • Honkavaara, Eija; Saari, Heikki; Kaivosoja, Jere
  • Remote Sensing, Vol. 5, Issue 10
  • DOI: 10.3390/rs5105006

Towards the Development of a Smart Flying Sensor: Illustration in the Field of Precision Agriculture
journal, July 2015

  • Hernandez, Andres; Murcia, Harold; Copot, Cosmin
  • Sensors, Vol. 15, Issue 7
  • DOI: 10.3390/s150716688

Field high-throughput phenotyping: the new crop breeding frontier
journal, January 2014


Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance
journal, October 2015


Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer
journal, January 2015

  • Burkart, Andreas; Aasen, Helge; Alonso, Luis
  • Remote Sensing, Vol. 7, Issue 1
  • DOI: 10.3390/rs70100725

Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping
journal, July 2014


Calibration of a Pushbroom Hyperspectral Imaging System for Agricultural Inspection
journal, January 2003


Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements
journal, November 2012


Remote sensing of sagebrush canopy nitrogen
journal, September 2012

  • Mitchell, Jessica J.; Glenn, Nancy F.; Sankey, Temuulen T.
  • Remote Sensing of Environment, Vol. 124
  • DOI: 10.1016/j.rse.2012.05.002

Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle
journal, March 2009

  • Berni, J.; Zarco-Tejada, P. J.; Suarez, L.
  • IEEE Transactions on Geoscience and Remote Sensing, Vol. 47, Issue 3
  • DOI: 10.1109/TGRS.2008.2010457

Bundle Adjustment with Self–Calibration Using Straight Lines
journal, October 2002

  • Habib, Ayman F.; Morgan, Michel; Lee, Young–Ran
  • The Photogrammetric Record, Vol. 17, Issue 100
  • DOI: 10.1111/0031-868X.00211

Uav Photogrammetry for Mapping and 3d Modeling – Current Status and Future Perspectives
journal, January 2011


A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles
journal, November 2014

  • Suomalainen, Juha; Anders, Niels; Iqbal, Shahzad
  • Remote Sensing, Vol. 6, Issue 11
  • DOI: 10.3390/rs61111013

Low-altitude Terrestrial Spectroscopy from a Pushbroom Sensor: Low-Altitude Terrestrial Spectroscopy
journal, October 2015

  • Ramirez-Paredes, Juan-Pablo; Lary, David J.; Gans, Nicholas R.
  • Journal of Field Robotics, Vol. 33, Issue 6
  • DOI: 10.1002/rob.21624

Distinctive Image Features from Scale-Invariant Keypoints
journal, November 2004


Speeded-Up Robust Features (SURF)
journal, June 2008

  • Bay, Herbert; Ess, Andreas; Tuytelaars, Tinne
  • Computer Vision and Image Understanding, Vol. 110, Issue 3
  • DOI: 10.1016/j.cviu.2007.09.014

Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images
journal, November 2011

  • Sedaghat, Amin; Mokhtarzade, Mehdi; Ebadi, Hamid
  • IEEE Transactions on Geoscience and Remote Sensing, Vol. 49, Issue 11
  • DOI: 10.1109/TGRS.2011.2144607

Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas
journal, September 2014

  • Han, Youkyung; Choi, Jaewan; Byun, Younggi
  • IEEE Transactions on Geoscience and Remote Sensing, Vol. 52, Issue 9
  • DOI: 10.1109/TGRS.2013.2291001

Multilevel SIFT Matching for Large-Size VHR Image Registration
journal, March 2012

  • Huo, Chunlei; Pan, Chunhong; Huo, Leigang
  • IEEE Geoscience and Remote Sensing Letters, Vol. 9, Issue 2
  • DOI: 10.1109/LGRS.2011.2163491

A robust multisource image automatic registration system based on the SIFT descriptor
journal, December 2011


A fast and fully automatic registration approach based on point features for multi-source remote-sensing images
journal, July 2008


Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT
journal, July 2013


Automatic Registration of High-Resolution Images Using Local Properties of Features
journal, March 2012

  • Han, You Kyung; Byun, Young Gi; Choi, Jae Wan
  • Photogrammetric Engineering & Remote Sensing, Vol. 78, Issue 3
  • DOI: 10.14358/PERS.78.3.211

A Robust Image Matching Method based on Optimized BaySAC
journal, November 2014

  • Kang, Zhizhong; Jia, Fengman; Zhang, Liqiang
  • Photogrammetric Engineering & Remote Sensing, Vol. 80, Issue 11
  • DOI: 10.14358/PERS.80.11.1041

Automatic and accurate registration of VHR optical and SAR images using a quadtree structure
journal, April 2015


A Fast and Reliable Matching Method for Automated Georeferencing of Remotely-Sensed Imagery
journal, January 2016

  • Long, Tengfei; Jiao, Weili; He, Guojin
  • Remote Sensing, Vol. 8, Issue 1
  • DOI: 10.3390/rs8010056

Feature-Area Optimization: A Novel SAR Image Registration Method
journal, February 2016

  • Liu, Fuqiang; Bi, Fukun; Chen, Liang
  • IEEE Geoscience and Remote Sensing Letters, Vol. 13, Issue 2
  • DOI: 10.1109/LGRS.2015.2507982

Robust regression methods for computer vision: A review
journal, April 1991

  • Meer, Peter; Mintz, Doron; Rosenfeld, Azriel
  • International Journal of Computer Vision, Vol. 6, Issue 1
  • DOI: 10.1007/BF00127126

Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems
journal, January 2014


Rapid and low-cost insect detection for analysing species trapped on yellow sticky traps
journal, May 2021


Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer
text, January 2015


Works referencing / citing this record:

Automated Coregistration of Multisensor Orthophotos Generated from Unmanned Aerial Vehicle Platforms
journal, April 2019


Implementation of a UAV–Hyperspectral Pushbroom Imager for Ecological Monitoring
journal, January 2019


Automated Aerial Triangulation for UAV-Based Mapping
journal, December 2018

  • He, Fangning; Zhou, Tian; Xiong, Weifeng
  • Remote Sensing, Vol. 10, Issue 12
  • DOI: 10.3390/rs10121952

A Simulation Environment for Validation and Verification of Real Time Hyperspectral Processing Algorithms on-Board a UAV
journal, August 2019

  • Horstrand, Pablo; López, José Fco.; López, Sebastián
  • Remote Sensing, Vol. 11, Issue 16
  • DOI: 10.3390/rs11161852

An Under-Ice Hyperspectral and RGB Imaging System to Capture Fine-Scale Biophysical Properties of Sea Ice
journal, December 2019

  • Cimoli, Emiliano; Meiners, Klaus M.; Lucieer, Arko
  • Remote Sensing, Vol. 11, Issue 23
  • DOI: 10.3390/rs11232860

The DOM Generation and Precise Radiometric Calibration of a UAV-Mounted Miniature Snapshot Hyperspectral Imager
journal, June 2017

  • Yang, Guijun; Li, Changchun; Wang, Yanjie
  • Remote Sensing, Vol. 9, Issue 7
  • DOI: 10.3390/rs9070642

Intercomparison of Unmanned Aerial Vehicle and Ground-Based Narrow Band Spectrometers Applied to Crop Trait Monitoring in Organic Potato Production
journal, June 2017

  • Domingues Franceschini, Marston; Bartholomeus, Harm; van Apeldoorn, Dirk
  • Sensors, Vol. 17, Issue 6
  • DOI: 10.3390/s17061428

Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery
journal, May 2018


Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery
journal, May 2018