Automated Aerial Triangulation for UAV-Based Mapping
Abstract
Accurate 3D reconstruction/modelling from unmanned aerial vehicle (UAV)-based imagery has become the key prerequisite in various applications. Although current commercial software has automated the process of image-based reconstruction, a transparent system, which can be incorporated with different user-defined constraints, is still preferred by the photogrammetric research community. In this regard, this paper presents a transparent framework for the automated aerial triangulation of UAV images. The proposed framework is conducted in three steps. In the first step, two approaches, which take advantage of prior information regarding the flight trajectory, are implemented for reliable relative orientation recovery. Then, initial recovery of image exterior orientation parameters (EOPs) is achieved through either an incremental or global approach. Finally, a global bundle adjustment involving Ground Control Points (GCPs) and check points is carried out to refine all estimated parameters in the defined mapping coordinate system. Four real image datasets, which are acquired by two different UAV platforms, have been utilized to evaluate the feasibility of the proposed framework. In addition, a comparative analysis between the proposed framework and the existing commercial software is performed. The derived experimental results demonstrate the superior performance of the proposed framework in providing an accurate 3D model, especially when dealingmore »
- Authors:
-
- Purdue Univ., West Lafayette, IN (United States)
- Publication Date:
- Research Org.:
- Purdue Univ., West Lafayette, IN (United States)
- Sponsoring Org.:
- USDOE Advanced Research Projects Agency - Energy (ARPA-E)
- OSTI Identifier:
- 1613657
- Grant/Contract Number:
- AR0000593
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Remote Sensing
- Additional Journal Information:
- Journal Volume: 10; Journal Issue: 12; Journal ID: ISSN 2072-4292
- Publisher:
- MDPI
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 47 OTHER INSTRUMENTATION; Remote Sensing; unmanned aerial vehicle; 3D reconstruction; structure from motion; relative orientation; exterior orientation parameters; bundle adjustment
Citation Formats
He, Fangning, Zhou, Tian, Xiong, Weifeng, Hasheminnasab, Seyyed, and Habib, Ayman. Automated Aerial Triangulation for UAV-Based Mapping. United States: N. p., 2018.
Web. doi:10.3390/rs10121952.
He, Fangning, Zhou, Tian, Xiong, Weifeng, Hasheminnasab, Seyyed, & Habib, Ayman. Automated Aerial Triangulation for UAV-Based Mapping. United States. https://doi.org/10.3390/rs10121952
He, Fangning, Zhou, Tian, Xiong, Weifeng, Hasheminnasab, Seyyed, and Habib, Ayman. Tue .
"Automated Aerial Triangulation for UAV-Based Mapping". United States. https://doi.org/10.3390/rs10121952. https://www.osti.gov/servlets/purl/1613657.
@article{osti_1613657,
title = {Automated Aerial Triangulation for UAV-Based Mapping},
author = {He, Fangning and Zhou, Tian and Xiong, Weifeng and Hasheminnasab, Seyyed and Habib, Ayman},
abstractNote = {Accurate 3D reconstruction/modelling from unmanned aerial vehicle (UAV)-based imagery has become the key prerequisite in various applications. Although current commercial software has automated the process of image-based reconstruction, a transparent system, which can be incorporated with different user-defined constraints, is still preferred by the photogrammetric research community. In this regard, this paper presents a transparent framework for the automated aerial triangulation of UAV images. The proposed framework is conducted in three steps. In the first step, two approaches, which take advantage of prior information regarding the flight trajectory, are implemented for reliable relative orientation recovery. Then, initial recovery of image exterior orientation parameters (EOPs) is achieved through either an incremental or global approach. Finally, a global bundle adjustment involving Ground Control Points (GCPs) and check points is carried out to refine all estimated parameters in the defined mapping coordinate system. Four real image datasets, which are acquired by two different UAV platforms, have been utilized to evaluate the feasibility of the proposed framework. In addition, a comparative analysis between the proposed framework and the existing commercial software is performed. The derived experimental results demonstrate the superior performance of the proposed framework in providing an accurate 3D model, especially when dealing with acquired UAV images containing repetitive pattern and significant image distortions.},
doi = {10.3390/rs10121952},
journal = {Remote Sensing},
number = 12,
volume = 10,
place = {United States},
year = {Tue Dec 04 00:00:00 EST 2018},
month = {Tue Dec 04 00:00:00 EST 2018}
}
Web of Science
Works referenced in this record:
Improving Orthorectification of UAV-Based Push-Broom Scanner Imagery Using Derived Orthophotos From Frame Cameras
journal, January 2017
- Habib, Ayman; Xiong, Weifeng; He, Fangning
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, Issue 1
Computing Helmert transformations
journal, December 2006
- Watson, G. A.
- Journal of Computational and Applied Mathematics, Vol. 197, Issue 2
A Non-Iterative Algorithm for Determining All Essential Matrices Corresponding to Five Point Pairs
journal, October 1996
- Philip, J.
- The Photogrammetric Record, Vol. 15, Issue 88
Automated Relative Orientation of UAV-Based Imagery in the Presence of Prior Information for the Flight Trajectory
journal, November 2016
- He, Fangning; Habib, Ayman
- Photogrammetric Engineering & Remote Sensing, Vol. 82, Issue 11
SBA: A software package for generic sparse bundle adjustment
journal, March 2009
- Lourakis, Manolis I. A.; Argyros, Antonis A.
- ACM Transactions on Mathematical Software, Vol. 36, Issue 1
Using an Unmanned Aerial Vehicle-Based Digital Imaging System to Derive a 3D Point Cloud for Landslide Scarp Recognition
journal, January 2016
- Al-Rawabdeh, Abdulla; He, Fangning; Moussa, Adel
- Remote Sensing, Vol. 8, Issue 2
Use of Unmanned Aerial Vehicles for Monitoring Recovery of Forest Vegetation on Petroleum Well Sites
journal, April 2017
- Hird, Jennifer; Montaghi, Alessandro; McDermid, Gregory
- Remote Sensing, Vol. 9, Issue 5
Modeling and Testing of Growth Status for Chinese Cabbage and White Radish with UAV-Based RGB Imagery
journal, April 2018
- Kim, Dong-Wook; Yun, Hee; Jeong, Sang-Jin
- Remote Sensing, Vol. 10, Issue 4
A computer algorithm for reconstructing a scene from two projections
journal, September 1981
- Longuet-Higgins, H. C.
- Nature, Vol. 293, Issue 5828
Unmanned Aerial Vehicles (UAVs) for Surveying Marine Fauna: A Dugong Case Study
journal, November 2013
- Hodgson, Amanda; Kelly, Natalie; Peel, David
- PLoS ONE, Vol. 8, Issue 11
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography
journal, June 1981
- Fischler, Martin A.; Bolles, Robert C.
- Communications of the ACM, Vol. 24, Issue 6
A New Solution to the Relative Orientation Problem Using Only 3 Points and the Vertical Direction
journal, November 2010
- Kalantari, Mahzad; Hashemi, Amir; Jung, Franck
- Journal of Mathematical Imaging and Vision, Vol. 39, Issue 3
Rotation Averaging
journal, January 2013
- Hartley, Richard; Trumpf, Jochen; Dai, Yuchao
- International Journal of Computer Vision, Vol. 103, Issue 3
Boresight Calibration of GNSS/INS-Assisted Push-Broom Hyperspectral Scanners on UAV Platforms
journal, May 2018
- Habib, Ayman; Zhou, Tian; Masjedi, Ali
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 11, Issue 5
Accuracy of Photogrammetric UAV-Based Point Clouds under Conditions of Partially-Open Forest Canopy
journal, April 2017
- Tomaštík, Julián; Mokroš, Martin; Saloň, Šimon
- Forests, Vol. 8, Issue 5
An efficient solution to the five-point relative pose problem
journal, June 2004
- Nister, D.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, Issue 6
Bundle Adjustment Methods in Engineering Photogrammetry
journal, October 1980
- Granshaw, S. I.
- The Photogrammetric Record, Vol. 10, Issue 56
Planar Constraints for an Improved Uav-Image-Based Dense Point Cloud Generation
journal, January 2015
- He, F.; Habib, A.; Al-Rawabdeh, A.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1/W4
Application of Multispectral Sensors Carried on Unmanned Aerial Vehicle (UAV) to Trophic State Mapping of Small Reservoirs: A Case Study of Tain-Pu Reservoir in Kinmen, Taiwan
journal, August 2015
- Su, Tung-Ching; Chou, Hung-Ta
- Remote Sensing, Vol. 7, Issue 8
Performance Evaluation of Alternative Relative Orientation Procedures for UAV-based Imagery with Prior Flight Trajectory Information
journal, January 2016
- He, F.; Habib, A.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XLI-B3
Distinctive Image Features from Scale-Invariant Keypoints
journal, November 2004
- Lowe, David G.
- International Journal of Computer Vision, Vol. 60, Issue 2, p. 91-110
Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images
journal, April 2015
- Candiago, Sebastian; Remondino, Fabio; De Giglio, Michaela
- Remote Sensing, Vol. 7, Issue 4
In defense of the eight-point algorithm
journal, June 1997
- Hartley, R. I.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, Issue 6
Imaging and photogrammetry models of Olduvai Gorge (Tanzania) by Unmanned Aerial Vehicles: A high-resolution digital database for research and conservation of Early Stone Age sites
journal, November 2016
- Jorayev, Gaygysyz; Wehr, Karol; Benito-Calvo, Alfonso
- Journal of Archaeological Science, Vol. 75
Motion from point matches: Multiplicity of solutions
journal, June 1990
- Faugeras, Olivier D.; Maybank, Steve
- International Journal of Computer Vision, Vol. 4, Issue 3
Direct Georeferencing with on Board Navigation Components of Light Weight uav Platforms
journal, January 2012
- Pfeifer, N.; Glira, P.; Briese, C.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXIX-B7
Digital camera self-calibration
journal, August 1997
- Fraser, Clive S.
- ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 52, Issue 4
Uav Photogrammetry for Mapping and 3d Modeling – Current Status and Future Perspectives
journal, January 2011
- Remondino, F.; Barazzetti, L.; Nex, F.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII-1/C22
Automatic calibration of low-cost digital cameras
journal, April 2003
- Morgan, Michel F.
- Optical Engineering, Vol. 42, Issue 4
Closed-form solution of absolute orientation using unit quaternions
journal, January 1987
- Horn, Berthold K. P.
- Journal of the Optical Society of America A, Vol. 4, Issue 4
A Closed-Form Solution for Coarse Registration of Point Clouds Using Linear Features
journal, August 2016
- Fangning, He; Ayman, Habib
- Journal of Surveying Engineering, Vol. 142, Issue 3
Issues in Unmanned Aerial Systems (UAS) Data Collection of Complex Forest Environments
journal, June 2018
- Fraser, Benjamin; Congalton, Russell
- Remote Sensing, Vol. 10, Issue 6
Automated Ortho-Rectification of UAV-Based Hyperspectral Data over an Agricultural Field Using Frame RGB Imagery
journal, September 2016
- Habib, Ayman; Han, Youkyung; Xiong, Weifeng
- Remote Sensing, Vol. 8, Issue 10
Performance evaluation of 1-point-RANSAC visual odometry
journal, August 2011
- Scaramuzza, Davide
- Journal of Field Robotics, Vol. 28, Issue 5
Bundle Block Adjustment with 3D Natural Cubic Splines
journal, December 2009
- Lee, Won Hee; Yu, Kiyun
- Sensors, Vol. 9, Issue 12
Relative orientation
journal, January 1990
- Horn, Berthold K. P.
- International Journal of Computer Vision, Vol. 4, Issue 1
Two Efficient Solutions for Visual Odometry Using Directional Correspondence
journal, April 2012
- Naroditsky, O.; Zhou, X. S.; Gallier, J.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, Issue 4
An Assessment of Small Unmanned Aerial Vehicles for Wildlife Research
journal, October 2006
- Jones, George Pierce; Pearlstine, Leonard G.; Percival, H. Franklin
- Wildlife Society Bulletin, Vol. 34, Issue 3
Region-Based 3d Surface Reconstruction Using Images Acquired by Low-Cost Unmanned Aerial Systems
journal, January 2015
- Lari, Z.; Al-Rawabdeh, A.; He, F.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1/W4
Unmanned Aerial Vehicle (UAV) for Monitoring Soil Erosion in Morocco
journal, November 2012
- d'Oleire-Oltmanns, Sebastian; Marzolff, Irene; Peter, Klaus
- Remote Sensing, Vol. 4, Issue 11
Indoor robot motion based on monocular images
journal, April 2001
- Ortín, D.; Montiel, J. M. M.
- Robotica, Vol. 19, Issue 3
Analysis of Landslide Evolution Affecting Olive Groves Using UAV and Photogrammetric Techniques
journal, October 2016
- Fernández, Tomás; Pérez, José; Cardenal, Javier
- Remote Sensing, Vol. 8, Issue 10
Image-Based Modelling from Unmanned Aerial Vehicle (UAV) Photogrammetry: An Effective, Low-Cost Tool for Archaeological Applications: Image-based modelling from UAV photogrammetry
journal, January 2014
- Fernández-Hernandez, J.; González-Aguilera, D.; Rodríguez-Gonzálvez, P.
- Archaeometry, Vol. 57, Issue 1
Linear Approach for Initial Recovery of the Exterior Orientation Parameters of Randomly Captured Images by Low-Cost Mobile Mapping Systems
journal, January 2014
- He, F.; Habib, A.
- ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1
Structure-from-motion using lines: Representation, triangulation, and bundle adjustment
journal, December 2005
- Bartoli, Adrien; Sturm, Peter
- Computer Vision and Image Understanding, Vol. 100, Issue 3
Rapid and low-cost insect detection for analysing species trapped on yellow sticky traps
journal, May 2021
- Böckmann, Elias; Pfaff, Alexander; Schirrmann, Michael
- Scientific Reports, Vol. 11, Issue 1
Motion from point matches: multiplicity of solutions
conference, January 1989
- Faugeras, O. D.; Maybank, S.
- [1989] Proceedings. Workshop on Visual Motion
An efficient solution to the five-point relative pose problem
conference, January 2003
- Nister, D.
- CVPR 2003: Computer Vision and Pattern Recognition Conference, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
Performance Evaluation of Alternative Relative Orientation Procedures for UAV-based Imagery with Prior Flight Trajectory Information
journal, January 2016
- He, F.; Habib, A.
- The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XLI-B3
A New Solution to the Relative Orientation Problem using only 3 Points and the Vertical Direction
text, January 2009
- Kalantari, Mahzad; Hashemi, Amir; Jung, Franck
- arXiv
Works referencing / citing this record:
UAV RTK/PPK Method—An Optimal Solution for Mapping Inaccessible Forested Areas?
journal, March 2019
- Tomaštík, Julián; Mokroš, Martin; Surový, Peter
- Remote Sensing, Vol. 11, Issue 6
Topology-Aware Road Network Extraction via Multi-Supervised Generative Adversarial Networks
journal, April 2019
- Zhang, Yang; Xiong, Zhangyue; Zang, Yu
- Remote Sensing, Vol. 11, Issue 9
Three-Dimensional Reconstruction of Structural Surface Model of Heritage Bridges Using UAV-Based Photogrammetric Point Clouds
journal, May 2019
- Pan, Yue; Dong, Yiqing; Wang, Dalei
- Remote Sensing, Vol. 11, Issue 10
Evaluation of UAV LiDAR for Mapping Coastal Environments
journal, December 2019
- Lin, Yi-Chun; Cheng, Yi-Ting; Zhou, Tian
- Remote Sensing, Vol. 11, Issue 24
Towards Benthic Habitat 3D Mapping Using Machine Learning Algorithms and Structures from Motion Photogrammetry
journal, January 2020
- Mohamed, Hassan; Nadaoka, Kazuo; Nakamura, Takashi
- Remote Sensing, Vol. 12, Issue 1
GNSS/INS-Assisted Structure from Motion Strategies for UAV-Based Imagery over Mechanized Agricultural Fields
journal, January 2020
- Hasheminasab, Seyyed Meghdad; Zhou, Tian; Habib, Ayman
- Remote Sensing, Vol. 12, Issue 3