DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: GNSS/INS-Assisted Structure from Motion Strategies for UAV-Based Imagery over Mechanized Agricultural Fields

Journal Article · · Remote Sensing
DOI: https://doi.org/10.3390/rs12030351 · OSTI ID:1592811

Acquired imagery by unmanned aerial vehicles (UAVs) has been widely used for three-dimensional (3D) reconstruction/modeling in various digital agriculture applications, such as phenotyping, crop monitoring, and yield prediction. 3D reconstruction from well-textured UAV-based images has matured and the user community has access to several commercial and opensource tools that provide accurate products at a high level of automation. However, in some applications, such as digital agriculture, due to repetitive image patterns, these approaches are not always able to produce reliable/complete products. The main limitation of these techniques is their inability to establish a sufficient number of correctly matched features among overlapping images, causing incomplete and/or inaccurate 3D reconstruction. This paper provides two structure from motion (SfM) strategies, which use trajectory information provided by an onboard survey-grade global navigation satellite system/inertial navigation system (GNSS/INS) and system calibration parameters. The main difference between the proposed strategies is that the first one—denoted as partially GNSS/INS-assisted SfM—implements the four stages of an automated triangulation procedure, namely, imaging matching, relative orientation parameters (ROPs) estimation, exterior orientation parameters (EOPs) recovery, and bundle adjustment (BA). The second strategy— denoted as fully GNSS/INS-assisted SfM—removes the EOPs estimation step while introducing a random sample consensus (RANSAC)-based strategy for removing matching outliers before the BA stage. Both strategies modify the image matching by restricting the search space for conjugate points. They also implement a linear procedure for ROPs’ refinement. Finally, they use the GNSS/INS information in modified collinearity equations for a simpler BA procedure that could be used for refining system calibration parameters. Eight datasets over six agricultural fields are used to evaluate the performance of the developed strategies. In comparison with a traditional SfM framework and Pix4D Mapper Pro, the proposed strategies are able to generate denser and more accurate 3D point clouds as well as orthophotos without any gaps.

Sponsoring Organization:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
Grant/Contract Number:
AR0000593
OSTI ID:
1592811
Journal Information:
Remote Sensing, Journal Name: Remote Sensing Journal Issue: 3 Vol. 12; ISSN 2072-4292
Publisher:
MDPI AGCopyright Statement
Country of Publication:
Switzerland
Language:
English

References (40)

Relative orientation journal January 1990
Rotation Averaging journal January 2013
Big Data in Smart Farming – A review journal May 2017
Feeding 10 billion people under climate change: How large is the production gap of current agricultural systems? journal September 2014
Three-point-based solution for automated motion parameter estimation of a multi-camera indoor mapping system with planar motion constraint journal August 2018
Indoor robot motion based on monocular images journal April 2001
Distinctive Image Features from Scale-Invariant Keypoints journal November 2004
A computer algorithm for reconstructing a scene from two projections journal September 1981
Calibration and accuracy assessment in a direct georeferencing system for UAS photogrammetry journal February 2018
Is There a Need for a More Sustainable Agriculture? journal January 2011
DEM orientation based on local feature correspondence with global DEMs journal August 2017
In defense of the eight-point algorithm journal June 1997
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras journal January 2017
Simultaneous System Calibration of a Multi-LiDAR Multicamera Mobile Mapping Platform journal May 2018
Boresight Calibration of GNSS/INS-Assisted Push-Broom Hyperspectral Scanners on UAV Platforms journal May 2018
Corn Plant Counting Using Deep Learning and UAV Images journal January 2019
Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle journal March 2009
An efficient solution to the five-point relative pose problem journal June 2004
Drift detection and removal for sequential structure from motion algorithms journal October 2004
A performance evaluation of local descriptors journal October 2005
Building Damage Extraction from Post-earthquake Airborne LiDAR Data journal August 2016
Using unmanned aerial vehicle-based multispectral, RGB and thermal imagery for phenotyping of forest genetic trials: A case study in Pinus halepensis journal January 2019
Food Security: The Challenge of Feeding 9 Billion People journal January 2010
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography journal June 1981
Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research journal July 2016
Automated Relative Orientation of UAV-Based Imagery in the Presence of Prior Information for the Flight Trajectory journal November 2016
Unmanned Aerial Vehicle Remote Sensing for Field-Based Crop Phenotyping: Current Status and Perspectives journal June 2017
Unmanned Aerial Vehicle-Based Phenotyping Using Morphometric and Spectral Analysis Can Quantify Responses of Wild Tomato Plants to Salinity Stress journal March 2019
Deep Learning-Based Damage Detection from Aerial SfM Point Clouds journal August 2019
Automated Aerial Triangulation for UAV-Based Mapping journal December 2018
Rapid Mosaicking of Unmanned Aerial Vehicle (UAV) Images for Crop Growth Monitoring Using the SIFT Algorithm journal May 2019
New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems journal August 2019
Phenotyping of Corn Plants Using Unmanned Aerial Vehicle (UAV) Images journal August 2019
Establishment of Plot-Yield Prediction Models in Soybean Breeding Programs Using UAV-Based Hyperspectral Remote Sensing journal November 2019
Accurate Calibration Scheme for a Multi-Camera Mobile Mapping System journal November 2019
Evaluation of UAV LiDAR for Mapping Coastal Environments journal December 2019
A Deep Learning Semantic Segmentation-Based Approach for Field-Level Sorghum Panicle Counting journal December 2019
Acquisition of NIR-Green-Blue Digital Photographs from Unmanned Aircraft for Crop Monitoring journal January 2010
An Automated Technique for Generating Georectified Mosaics from Ultra-High Resolution Unmanned Aerial Vehicle (UAV) Imagery, Based on Structure from Motion (SfM) Point Clouds journal May 2012
Assessment of Unmanned Aerial Vehicles Imagery for Quantitative Monitoring of Wheat Crop in Small Plots journal May 2008