Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

LiDAR-Aided Interior Orientation Parameters Refinement Strategy for Consumer-Grade Cameras Onboard UAV Remote Sensing Systems

Journal Article · · Remote Sensing
DOI:https://doi.org/10.3390/rs12142268· OSTI ID:2503553

Unmanned aerial vehicles (UAVs) are quickly emerging as a popular platform for 3D reconstruction/modeling in various applications such as precision agriculture, coastal monitoring, and emergency management. For such applications, LiDAR and frame cameras are the two most commonly used sensors for 3D mapping of the object space. For example, point clouds for the area of interest can be directly derived from LiDAR sensors onboard UAVs equipped with integrated global navigation satellite systems and inertial navigation systems (GNSS/INS). Imagery-based mapping, on the other hand, is considered to be a cost-effective and practical option and is often conducted by generating point clouds and orthophotos using structure from motion (SfM) techniques. Mapping with photogrammetric approaches requires accurate camera interior orientation parameters (IOPs), especially when direct georeferencing is utilized. Most state-of-the-art approaches for determining/refining camera IOPs depend on ground control points (GCPs). However, establishing GCPs is expensive and labor-intensive, and more importantly, the distribution and number of GCPs are usually less than optimal to provide adequate control for determining and/or refining camera IOPs. Moreover, consumer-grade cameras with unstable IOPs have been widely used for mapping applications. Therefore, in such scenarios, where frequent camera calibration or IOP refinement is required, GCP-based approaches are impractical. To eliminate the need for GCPs, this study uses LiDAR data as a reference surface to perform in situ refinement of camera IOPs. The proposed refinement strategy is conducted in three main steps. An image-based sparse point cloud is first generated via a GNSS/INS-assisted SfM strategy. Then, LiDAR points corresponding to the resultant image-based sparse point cloud are identified through an iterative plane fitting approach and are referred to as LiDAR control points (LCPs). Finally, IOPs of the utilized camera are refined through a GNSS/INS-assisted bundle adjustment procedure using LCPs. Seven datasets over two study sites with a variety of geomorphic features are used to evaluate the performance of the developed strategy. The results illustrate the ability of the proposed approach to achieve an object space absolute accuracy of 3–5 cm (i.e., 5–10 times the ground sampling distance) at a 41 m flying height.

Sponsoring Organization:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
Grant/Contract Number:
AR0001135
OSTI ID:
2503553
Alternate ID(s):
OSTI ID: 1799144
Journal Information:
Remote Sensing, Journal Name: Remote Sensing Journal Issue: 14 Vol. 12; ISSN RSBSBZ; ISSN 2072-4292
Publisher:
MDPI AGCopyright Statement
Country of Publication:
Switzerland
Language:
English

References (28)

UAV for 3D mapping applications: a review journal November 2013
Aerial hyperspectral imagery and deep neural networks for high-throughput yield phenotyping in wheat journal May 2020
Geometric test field calibration of digital photogrammetric sensors journal September 2006
In-flight photogrammetric camera calibration and validation via complementary lidar journal February 2015
Sensor modelling and camera calibration for close-range photogrammetry journal May 2016
Distinctive Image Features from Scale-Invariant Keypoints journal November 2004
Applications of UAVs in Civil Infrastructure journal June 2019
The impact of number and spatial distribution of GCPs on the positional accuracy of geospatial products derived from low-cost UASs journal September 2018
A study of integration of LIDAR and photogrammetric data sets by indirect georeferencing and in situ camera calibration journal February 2017
A flexible new technique for camera calibration journal January 2000
Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges journal January 2019
Sorghum Biomass Prediction Using Uav-Based Remote Sensing Data and Crop Model Simulation conference July 2018
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras journal January 2017
Simultaneous System Calibration of a Multi-LiDAR Multicamera Mobile Mapping Platform journal May 2018
Boresight Calibration of GNSS/INS-Assisted Push-Broom Hyperspectral Scanners on UAV Platforms journal May 2018
Accurate, Dense, and Robust Multiview Stereopsis journal August 2010
Stability analysis of low-cost digital cameras for aerial mapping using different georeferencing techniques journal March 2006
UAV-based multi-sensor multi-platform integration for high throughput phenotyping
  • Ravi, Radhika; Hasheminasab, Seyyed Meghdad; Zhou, Tian
  • Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping IV https://doi.org/10.1117/12.2519190
conference May 2019
Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works journal January 2016
Stability Analysis and Geometric Calibration of Off-the-Shelf Digital Cameras journal June 2005
Automated Detection, Localization, and Identification of Signalized Targets and Their Impact on Digital Camera Calibration journal August 2013
Automated Aerial Triangulation for UAV-Based Mapping journal December 2018
Evaluation of UAV LiDAR for Mapping Coastal Environments journal December 2019
Simulation and Analysis of Photogrammetric UAV Image Blocks—Influence of Camera Calibration Error journal December 2019
GNSS/INS-Assisted Structure from Motion Strategies for UAV-Based Imagery over Mechanized Agricultural Fields journal January 2020
Featured-Based Registration of Terrestrial Laser Scans with Minimum Overlap Using Photogrammetric Data journal August 2011
Uav Cameras: Overview and Geometric Calibration Benchmark journal January 2017
Investigations on the Quality of the Interior Orientation and its Impact in Object Space for uav Photogrammetry journal January 2015

Similar Records

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems
Journal Article · Thu Sep 09 00:00:00 EDT 2021 · ISPRS Journal of Photogrammetry and Remote Sensing · OSTI ID:1977227

Related Subjects