skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems

Abstract

The need for accurate 3D spatial information is growing rapidly in many of today’s key industries, such as precision agriculture, emergency management, infrastructure monitoring, and defense. Unmanned aerial vehicles (UAVs) equipped with global navigation satellite systems/inertial navigation systems (GNSS/INS) and consumer-grade digital imaging sensors are capable of providing accurate 3D spatial information at a relatively low cost. However, with the use of consumer-grade sensors, system calibration is critical for accurate 3D reconstruction. In this study, ‘consumer-grade’ refers to cameras that require system calibration by the user instead of by the manufacturer or other high-end laboratory settings, as well as relatively low-cost GNSS/INS units. In addition to classical spatial system calibration, many consumer-grade sensors also need temporal calibration for accurate 3D reconstruction. This study examines the accuracy impact of time delay in the synchronization between the GNSS/INS unit and cameras on-board UAV-based mapping systems. After reviewing existing strategies, this study presents two approaches (direct and indirect) to correct for time delay between GNSS/INS recorded event markers and actual time of image exposure. Our results show that both approaches are capable of handling and correcting this time delay, with the direct approach being more rigorous. When a time delay exists and themore » direct or indirect approach is applied, horizontal accuracy of 1–3 times the ground sampling distance (GSD) can be achieved without either the use of any ground control points (GCPs) or adjusting the original GNSS/INS trajectory information.« less

Authors:
; ; ; ;
Publication Date:
Research Org.:
Purdue Univ., West Lafayette, IN (United States)
Sponsoring Org.:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
OSTI Identifier:
1545968
Alternate Identifier(s):
OSTI ID: 1613658
Grant/Contract Number:  
AR0000593
Resource Type:
Published Article
Journal Name:
Remote Sensing
Additional Journal Information:
Journal Name: Remote Sensing Journal Volume: 11 Journal Issue: 15; Journal ID: ISSN 2072-4292
Publisher:
MDPI AG
Country of Publication:
Switzerland
Language:
English
Subject:
47 OTHER INSTRUMENTATION; Remote Sensing; time synchronization; unmanned aerial vehicles (UAVs), system calibration; GNSS/INS-assisted mapping; bundle adjustment

Citation Formats

LaForest,, Hasheminasab,, Zhou,, Flatt,, and Habib,. New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems. Switzerland: N. p., 2019. Web. https://doi.org/10.3390/rs11151811.
LaForest,, Hasheminasab,, Zhou,, Flatt,, & Habib,. New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems. Switzerland. https://doi.org/10.3390/rs11151811
LaForest,, Hasheminasab,, Zhou,, Flatt,, and Habib,. Thu . "New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems". Switzerland. https://doi.org/10.3390/rs11151811.
@article{osti_1545968,
title = {New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems},
author = {LaForest, and Hasheminasab, and Zhou, and Flatt, and Habib,},
abstractNote = {The need for accurate 3D spatial information is growing rapidly in many of today’s key industries, such as precision agriculture, emergency management, infrastructure monitoring, and defense. Unmanned aerial vehicles (UAVs) equipped with global navigation satellite systems/inertial navigation systems (GNSS/INS) and consumer-grade digital imaging sensors are capable of providing accurate 3D spatial information at a relatively low cost. However, with the use of consumer-grade sensors, system calibration is critical for accurate 3D reconstruction. In this study, ‘consumer-grade’ refers to cameras that require system calibration by the user instead of by the manufacturer or other high-end laboratory settings, as well as relatively low-cost GNSS/INS units. In addition to classical spatial system calibration, many consumer-grade sensors also need temporal calibration for accurate 3D reconstruction. This study examines the accuracy impact of time delay in the synchronization between the GNSS/INS unit and cameras on-board UAV-based mapping systems. After reviewing existing strategies, this study presents two approaches (direct and indirect) to correct for time delay between GNSS/INS recorded event markers and actual time of image exposure. Our results show that both approaches are capable of handling and correcting this time delay, with the direct approach being more rigorous. When a time delay exists and the direct or indirect approach is applied, horizontal accuracy of 1–3 times the ground sampling distance (GSD) can be achieved without either the use of any ground control points (GCPs) or adjusting the original GNSS/INS trajectory information.},
doi = {10.3390/rs11151811},
journal = {Remote Sensing},
number = 15,
volume = 11,
place = {Switzerland},
year = {2019},
month = {8}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.3390/rs11151811

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Automated Aerial Triangulation for UAV-Based Mapping
journal, December 2018

  • He, Fangning; Zhou, Tian; Xiong, Weifeng
  • Remote Sensing, Vol. 10, Issue 12
  • DOI: 10.3390/rs10121952

The Improvement of Land Cover Classification by Thermal Remote Sensing
journal, June 2015


UAV-Based High Resolution Thermal Imaging for Vegetation Monitoring, and Plant Phenotyping Using ICI 8640 P, FLIR Vue Pro R 640, and thermoMap Cameras
journal, February 2019

  • Sagan, Vasit; Maimaitijiang, Maitiniyazi; Sidike, Paheding
  • Remote Sensing, Vol. 11, Issue 3
  • DOI: 10.3390/rs11030330

UAV RTK/PPK Method—An Optimal Solution for Mapping Inaccessible Forested Areas?
journal, March 2019

  • Tomaštík, Julián; Mokroš, Martin; Surový, Peter
  • Remote Sensing, Vol. 11, Issue 6
  • DOI: 10.3390/rs11060721

Camera calibration with distortion models and accuracy evaluation
journal, January 1992

  • Weng, J.; Cohen, P.; Herniou, M.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, Issue 10
  • DOI: 10.1109/34.159901

Intercomparison of UAV, Aircraft and Satellite Remote Sensing Platforms for Precision Viticulture
journal, March 2015

  • Matese, Alessandro; Toscano, Piero; Di Gennaro, Salvatore
  • Remote Sensing, Vol. 7, Issue 3
  • DOI: 10.3390/rs70302971

A flexible new technique for camera calibration
journal, January 2000

  • Zhang, Z.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 11
  • DOI: 10.1109/34.888718

UAV and Ground Image-Based Phenotyping: A Proof of Concept with Durum Wheat
journal, May 2019

  • Gracia-Romero, Adrian; Kefauver, Shawn C.; Fernandez-Gallego, Jose A.
  • Remote Sensing, Vol. 11, Issue 10
  • DOI: 10.3390/rs11101244

Evaluating Maize Genotype Performance under Low Nitrogen Conditions Using RGB UAV Phenotyping Techniques
journal, April 2019

  • Buchaillot, Ma. Luisa; Gracia-Romero, Adrian; Vergara-Diaz, Omar
  • Sensors, Vol. 19, Issue 8
  • DOI: 10.3390/s19081815

Estimating high resolution evapotranspiration from disaggregated thermal images
journal, December 2016


Boresight Calibration of GNSS/INS-Assisted Push-Broom Hyperspectral Scanners on UAV Platforms
journal, May 2018

  • Habib, Ayman; Zhou, Tian; Masjedi, Ali
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 11, Issue 5
  • DOI: 10.1109/JSTARS.2018.2813263

Calibration and accuracy assessment in a direct georeferencing system for UAS photogrammetry
journal, February 2018

  • Gabrlik, Petr; Cour-Harbo, Anders la; Kalvodova, Petra
  • International Journal of Remote Sensing, Vol. 39, Issue 15-16
  • DOI: 10.1080/01431161.2018.1434331

Animating rotation with quaternion curves
journal, July 1985


Time synchronization of consumer cameras on Micro Aerial Vehicles
journal, January 2017


Simultaneous System Calibration of a Multi-LiDAR Multicamera Mobile Mapping Platform
journal, May 2018

  • Ravi, Radhika; Lin, Yun-Jou; Elbahnasawy, Magdy
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 11, Issue 5
  • DOI: 10.1109/JSTARS.2018.2812796

Comparison of four UAV georeferencing methods for environmental monitoring purposes focusing on the combined use with airborne and satellite remote sensing platforms
journal, March 2019

  • Padró, Joan-Cristian; Muñoz, Francisco-Javier; Planas, Jordi
  • International Journal of Applied Earth Observation and Geoinformation, Vol. 75
  • DOI: 10.1016/j.jag.2018.10.018

Illumination-Robust remote sensing image matching based on oriented self-similarity
journal, July 2019


Distinctive Image Features from Scale-Invariant Keypoints
journal, November 2004


A Micro-Uav with the Capability of Direct Georeferencing
journal, January 2013

  • Rehak, M.; Mabillard, R.; Skaloud, J.
  • ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1/W2
  • DOI: 10.5194/isprsarchives-XL-1-W2-317-2013

Bundle Adjustment with Self–Calibration Using Straight Lines
journal, October 2002

  • Habib, Ayman F.; Morgan, Michel; Lee, Young–Ran
  • The Photogrammetric Record, Vol. 17, Issue 100
  • DOI: 10.1111/0031-868X.00211

The Development of an UAV Borne Direct Georeferenced Photogrammetric Platform for Ground Control Point Free Applications
journal, July 2012

  • Chiang, Kai-Wei; Tsai, Meng-Lun; Chu, Chien-Hsun
  • Sensors, Vol. 12, Issue 7
  • DOI: 10.3390/s120709161

Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment
journal, April 2009


Estimation of Soil Moisture from Optical and Thermal Remote Sensing: A Review
journal, August 2016


Rigorous Boresight Self-Calibration of Mobile and UAV LiDAR Scanning Systems by Strip Adjustment
journal, February 2019

  • Li, Zhen; Tan, Junxiang; Liu, Hua
  • Remote Sensing, Vol. 11, Issue 4
  • DOI: 10.3390/rs11040442

An image-based four-source surface energy balance model to estimate crop evapotranspiration from solar reflectance/thermal emission data (SEB-4S)
journal, January 2014


Automated Ortho-Rectification of UAV-Based Hyperspectral Data over an Agricultural Field Using Frame RGB Imagery
journal, September 2016

  • Habib, Ayman; Han, Youkyung; Xiong, Weifeng
  • Remote Sensing, Vol. 8, Issue 10
  • DOI: 10.3390/rs8100796

UAS, sensors, and data processing in agroforestry: a review towards practical applications
journal, December 2016


New Calibration Method Using Low Cost MEM IMUs to Verify the Performance of UAV-Borne MMS Payloads
journal, March 2015

  • Chiang, Kai-Wei; Tsai, Meng-Lun; Naser, El-Sheimy
  • Sensors, Vol. 15, Issue 3
  • DOI: 10.3390/s150306560

An approach to improve direct sensor orientation using the integration of photogrammetric and lidar datasets
journal, February 2019

  • Costa, Felipe André Lima; Mitishita, Edson Aparecido
  • International Journal of Remote Sensing, Vol. 40, Issue 14
  • DOI: 10.1080/01431161.2019.1580794

    Works referencing / citing this record:

    GNSS/INS-Assisted Structure from Motion Strategies for UAV-Based Imagery over Mechanized Agricultural Fields
    journal, January 2020

    • Hasheminasab, Seyyed Meghdad; Zhou, Tian; Habib, Ayman
    • Remote Sensing, Vol. 12, Issue 3
    • DOI: 10.3390/rs12030351