Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery
Abstract
Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INSmore »
- Authors:
-
- Purdue Univ., West Lafayette, IN (United States)
- Purdue Univ., West Lafayette, IN (United States); Kyungpook National Univ., Sangju (Korea)
- Publication Date:
- Research Org.:
- Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1362128
- Grant/Contract Number:
- AR0000593
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Remote Sensing
- Additional Journal Information:
- Journal Volume: 8; Journal Issue: 10; Journal ID: ISSN 2072-4292
- Publisher:
- MDPI
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 47 OTHER INSTRUMENTATION; 60 APPLIED LIFE SCIENCES; automated image registration; ortho-rectification; hyperspectral push-broom scanners; phenotyping; SURF; UAV-based agricultural management
Citation Formats
Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, and Crawford, Melba. Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery. United States: N. p., 2016.
Web. doi:10.3390/rs8100796.
Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, & Crawford, Melba. Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery. United States. https://doi.org/10.3390/rs8100796
Habib, Ayman, Han, Youkyung, Xiong, Weifeng, He, Fangning, Zhang, Zhou, and Crawford, Melba. Sat .
"Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery". United States. https://doi.org/10.3390/rs8100796. https://www.osti.gov/servlets/purl/1362128.
@article{osti_1362128,
title = {Automated ortho-rectification of UAV-based hyperspectral data over an agricultural field using frame RGB imagery},
author = {Habib, Ayman and Han, Youkyung and Xiong, Weifeng and He, Fangning and Zhang, Zhou and Crawford, Melba},
abstractNote = {Low-cost Unmanned Airborne Vehicles (UAVs) equipped with consumer-grade imaging systems have emerged as a potential remote sensing platform that could satisfy the needs of a wide range of civilian applications. Among these applications, UAV-based agricultural mapping and monitoring have attracted significant attention from both the research and professional communities. The interest in UAV-based remote sensing for agricultural management is motivated by the need to maximize crop yield. Remote sensing-based crop yield prediction and estimation are primarily based on imaging systems with different spectral coverage and resolution (e.g., RGB and hyperspectral imaging systems). Due to the data volume, RGB imaging is based on frame cameras, while hyperspectral sensors are primarily push-broom scanners. To cope with the limited endurance and payload constraints of low-cost UAVs, the agricultural research and professional communities have to rely on consumer-grade and light-weight sensors. However, the geometric fidelity of derived information from push-broom hyperspectral scanners is quite sensitive to the available position and orientation established through a direct geo-referencing unit onboard the imaging platform (i.e., an integrated Global Navigation Satellite System (GNSS) and Inertial Navigation System (INS). This paper presents an automated framework for the integration of frame RGB images, push-broom hyperspectral scanner data and consumer-grade GNSS/INS navigation data for accurate geometric rectification of the hyperspectral scenes. The approach relies on utilizing the navigation data, together with a modified Speeded-Up Robust Feature (SURF) detector and descriptor, for automating the identification of conjugate features in the RGB and hyperspectral imagery. The SURF modification takes into consideration the available direct geo-referencing information to improve the reliability of the matching procedure in the presence of repetitive texture within a mechanized agricultural field. Identified features are then used to improve the geometric fidelity of the previously ortho-rectified hyperspectral data. Lastly, experimental results from two real datasets show that the geometric rectification of the hyperspectral data was improved by almost one order of magnitude.},
doi = {10.3390/rs8100796},
journal = {Remote Sensing},
number = 10,
volume = 8,
place = {United States},
year = {Sat Sep 24 00:00:00 EDT 2016},
month = {Sat Sep 24 00:00:00 EDT 2016}
}
Web of Science
Works referenced in this record:
Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images
journal, April 2015
- Candiago, Sebastian; Remondino, Fabio; De Giglio, Michaela
- Remote Sensing, Vol. 7, Issue 4
Future Scenarios for Plant Phenotyping
journal, April 2013
- Fiorani, Fabio; Schurr, Ulrich
- Annual Review of Plant Biology, Vol. 64, Issue 1
BreedVision — A Multi-Sensor Platform for Non-Destructive Field-Based Phenotyping in Plant Breeding
journal, February 2013
- Busemeyer, Lucas; Mentrup, Daniel; Möller, Kim
- Sensors, Vol. 13, Issue 3
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras
journal, January 2017
- Habib, Ayman; Xiong, Weifeng; He, Fangning
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, Issue 1
The application of small unmanned aerial systems for precision agriculture: a review
journal, July 2012
- Zhang, Chunhua; Kovacs, John M.
- Precision Agriculture, Vol. 13, Issue 6
Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture
journal, October 2013
- Honkavaara, Eija; Saari, Heikki; Kaivosoja, Jere
- Remote Sensing, Vol. 5, Issue 10
Towards the Development of a Smart Flying Sensor: Illustration in the Field of Precision Agriculture
journal, July 2015
- Hernandez, Andres; Murcia, Harold; Copot, Cosmin
- Sensors, Vol. 15, Issue 7
Field high-throughput phenotyping: the new crop breeding frontier
journal, January 2014
- Araus, José Luis; Cairns, Jill E.
- Trends in Plant Science, Vol. 19, Issue 1
Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance
journal, October 2015
- Aasen, Helge; Burkart, Andreas; Bolten, Andreas
- ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 108
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer
journal, January 2015
- Burkart, Andreas; Aasen, Helge; Alonso, Luis
- Remote Sensing, Vol. 7, Issue 1
Proximal Remote Sensing Buggies and Potential Applications for Field-Based Phenotyping
journal, July 2014
- Deery, David; Jimenez-Berni, Jose; Jones, Hamlyn
- Agronomy, Vol. 4, Issue 3
Calibration of a Pushbroom Hyperspectral Imaging System for Agricultural Inspection
journal, January 2003
- K. C. Lawrence,
- Transactions of the ASAE, Vol. 46, Issue 2
Diagnostic mapping of canopy nitrogen content in rice based on hyperspectral measurements
journal, November 2012
- Inoue, Yoshio; Sakaiya, Eiji; Zhu, Yan
- Remote Sensing of Environment, Vol. 126
Remote sensing of sagebrush canopy nitrogen
journal, September 2012
- Mitchell, Jessica J.; Glenn, Nancy F.; Sankey, Temuulen T.
- Remote Sensing of Environment, Vol. 124
Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle
journal, March 2009
- Berni, J.; Zarco-Tejada, P. J.; Suarez, L.
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 47, Issue 3
Bundle Adjustment with Self–Calibration Using Straight Lines
journal, October 2002
- Habib, Ayman F.; Morgan, Michel; Lee, Young–Ran
- The Photogrammetric Record, Vol. 17, Issue 100
Uav Photogrammetry for Mapping and 3d Modeling – Current Status and Future Perspectives
journal, January 2011
- Remondino, F.; Barazzetti, L.; Nex, F.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII-1/C22
A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles
journal, November 2014
- Suomalainen, Juha; Anders, Niels; Iqbal, Shahzad
- Remote Sensing, Vol. 6, Issue 11
Low-altitude Terrestrial Spectroscopy from a Pushbroom Sensor: Low-Altitude Terrestrial Spectroscopy
journal, October 2015
- Ramirez-Paredes, Juan-Pablo; Lary, David J.; Gans, Nicholas R.
- Journal of Field Robotics, Vol. 33, Issue 6
Distinctive Image Features from Scale-Invariant Keypoints
journal, November 2004
- Lowe, David G.
- International Journal of Computer Vision, Vol. 60, Issue 2, p. 91-110
Speeded-Up Robust Features (SURF)
journal, June 2008
- Bay, Herbert; Ess, Andreas; Tuytelaars, Tinne
- Computer Vision and Image Understanding, Vol. 110, Issue 3
Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images
journal, November 2011
- Sedaghat, Amin; Mokhtarzade, Mehdi; Ebadi, Hamid
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 49, Issue 11
Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas
journal, September 2014
- Han, Youkyung; Choi, Jaewan; Byun, Younggi
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 52, Issue 9
Multilevel SIFT Matching for Large-Size VHR Image Registration
journal, March 2012
- Huo, Chunlei; Pan, Chunhong; Huo, Leigang
- IEEE Geoscience and Remote Sensing Letters, Vol. 9, Issue 2
A robust multisource image automatic registration system based on the SIFT descriptor
journal, December 2011
- Wang, Li; Niu, Zheng; Wu, Chaoyang
- International Journal of Remote Sensing, Vol. 33, Issue 12
A fast and fully automatic registration approach based on point features for multi-source remote-sensing images
journal, July 2008
- Yu, Le; Zhang, Dengrong; Holden, Eun-Jung
- Computers & Geosciences, Vol. 34, Issue 7
Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT
journal, July 2013
- Bin Fan,
- IEEE Geoscience and Remote Sensing Letters, Vol. 10, Issue 4
Automatic Registration of High-Resolution Images Using Local Properties of Features
journal, March 2012
- Han, You Kyung; Byun, Young Gi; Choi, Jae Wan
- Photogrammetric Engineering & Remote Sensing, Vol. 78, Issue 3
A Robust Image Matching Method based on Optimized BaySAC
journal, November 2014
- Kang, Zhizhong; Jia, Fengman; Zhang, Liqiang
- Photogrammetric Engineering & Remote Sensing, Vol. 80, Issue 11
Automatic and accurate registration of VHR optical and SAR images using a quadtree structure
journal, April 2015
- Han, Youkyung; Byun, Younggi
- International Journal of Remote Sensing, Vol. 36, Issue 9
A Fast and Reliable Matching Method for Automated Georeferencing of Remotely-Sensed Imagery
journal, January 2016
- Long, Tengfei; Jiao, Weili; He, Guojin
- Remote Sensing, Vol. 8, Issue 1
Feature-Area Optimization: A Novel SAR Image Registration Method
journal, February 2016
- Liu, Fuqiang; Bi, Fukun; Chen, Liang
- IEEE Geoscience and Remote Sensing Letters, Vol. 13, Issue 2
Robust regression methods for computer vision: A review
journal, April 1991
- Meer, Peter; Mintz, Doron; Rosenfeld, Azriel
- International Journal of Computer Vision, Vol. 6, Issue 1
Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems
journal, January 2014
- He, F.; Habib, A.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1
Rapid and low-cost insect detection for analysing species trapped on yellow sticky traps
journal, May 2021
- Böckmann, Elias; Pfaff, Alexander; Schirrmann, Michael
- Scientific Reports, Vol. 11, Issue 1
Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based Goniometer
text, January 2015
- Andreas, Burkart,; Helge, Aasen,; Luis, Alonso,
- ETH Zurich
Works referencing / citing this record:
Comparison of leaf area index inversion for grassland vegetation through remotely sensed spectra by unmanned aerial vehicle and field-based spectroradiometer
journal, September 2018
- Sha, Zongyao; Wang, Yuwei; Bai, Yongfei
- Journal of Plant Ecology, Vol. 12, Issue 3
Automated Coregistration of Multisensor Orthophotos Generated from Unmanned Aerial Vehicle Platforms
journal, April 2019
- Han, Youkyung; Choi, Jaewan; Jung, Jinha
- Journal of Sensors, Vol. 2019
Implementation of a UAV–Hyperspectral Pushbroom Imager for Ecological Monitoring
journal, January 2019
- Arroyo-Mora, J.; Kalacska, Margaret; Inamdar, Deep
- Drones, Vol. 3, Issue 1
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows
journal, July 2018
- Aasen, Helge; Honkavaara, Eija; Lucieer, Arko
- Remote Sensing, Vol. 10, Issue 7
Automated Aerial Triangulation for UAV-Based Mapping
journal, December 2018
- He, Fangning; Zhou, Tian; Xiong, Weifeng
- Remote Sensing, Vol. 10, Issue 12
A Simulation Environment for Validation and Verification of Real Time Hyperspectral Processing Algorithms on-Board a UAV
journal, August 2019
- Horstrand, Pablo; López, José Fco.; López, Sebastián
- Remote Sensing, Vol. 11, Issue 16
An Under-Ice Hyperspectral and RGB Imaging System to Capture Fine-Scale Biophysical Properties of Sea Ice
journal, December 2019
- Cimoli, Emiliano; Meiners, Klaus M.; Lucieer, Arko
- Remote Sensing, Vol. 11, Issue 23
The DOM Generation and Precise Radiometric Calibration of a UAV-Mounted Miniature Snapshot Hyperspectral Imager
journal, June 2017
- Yang, Guijun; Li, Changchun; Wang, Yanjie
- Remote Sensing, Vol. 9, Issue 7
Intercomparison of Unmanned Aerial Vehicle and Ground-Based Narrow Band Spectrometers Applied to Crop Trait Monitoring in Organic Potato Production
journal, June 2017
- Domingues Franceschini, Marston; Bartholomeus, Harm; van Apeldoorn, Dirk
- Sensors, Vol. 17, Issue 6
Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery
journal, May 2018
- Han, Youkyung; Oh, Jaehong
- Sensors, Vol. 18, Issue 5
Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows
text, January 2018
- Aasen, Helge; Honkavaara, Eija; Lucieer, Arko
- ETH Zurich
Automated Geo/Co-Registration of Multi-Temporal Very-High-Resolution Imagery
journal, May 2018
- Han, Youkyung; Oh, Jaehong
- Sensors, Vol. 18, Issue 5