Volumetric calibration of a plenoptic camera

Hall, Elise Munz; Fahringer, Timothy W.; Guildenbecher, Daniel Robert; Thurow, Brian S.

doi:10.1364/AO.57.000914

Title: Volumetric calibration of a plenoptic camera

Journal Article · Thu Feb 01 00:00:00 EST 2018 · Applied Optics

DOI:https://doi.org/10.1364/AO.57.000914· OSTI ID:1421765

Hall, Elise Munz ^[1]; Fahringer, Timothy W. ^[2]; Guildenbecher, Daniel Robert ^[3]; Thurow, Brian S. ^[2]

Auburn Univ., Auburn, AL (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Auburn Univ., Auburn, AL (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Here, the volumetric calibration of a plenoptic camera is explored to correct for inaccuracies due to real-world lens distortions and thin-lens assumptions in current processing methods. Two methods of volumetric calibration based on a polynomial mapping function that does not require knowledge of specific lens parameters are presented and compared to a calibration based on thin-lens assumptions. The first method, volumetric dewarping, is executed by creation of a volumetric representation of a scene using the thin-lens assumptions, which is then corrected in post-processing using a polynomial mapping function. The second method, direct light-field calibration, uses the polynomial mapping in creation of the initial volumetric representation to relate locations in object space directly to image sensor locations. The accuracy and feasibility of these methods is examined experimentally by capturing images of a known dot card at a variety of depths. Results suggest that use of a 3D polynomial mapping function provides a significant increase in reconstruction accuracy and that the achievable accuracy is similar using either polynomial-mapping-based method. Additionally, direct light-field calibration provides significant computational benefits by eliminating some intermediate processing steps found in other methods. Finally, the flexibility of this method is shown for a nonplanar calibration.

View Accepted Manuscript (DOE)

View Accepted Manuscript (Publisher)

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000; NA0003525

OSTI ID:: 1421765

Alternate ID(s):: OSTI ID: 1418726

Report Number(s):: SAND-2018-0806J; APOPAI; 660487

Journal Information:: Applied Optics, Vol. 57, Issue 4; ISSN 1559-128X

Publisher:: Optical Society of AmericaCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 25 works

Citation information provided by
Web of Science

References (25)

Calibration and accuracy analysis of a focused plenoptic camera Zeller, N.; Quint, F.; Stilla, U. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. II-3 https://doi.org/10.5194/isprsannals-II-3-205-2014	journal	January 2014
Tomographic PIV: principles and practice Scarano, F. Measurement Science and Technology, Vol. 24, Issue 1 https://doi.org/10.1088/0957-0233/24/1/012001	journal	October 2012
Distortion compensation for generalized stereoscopic particle image velocimetry Soloff, S. M.; Adrian, R. J.; Liu, Z-C Measurement Science and Technology, Vol. 8, Issue 12 https://doi.org/10.1088/0957-0233/8/12/008	journal	December 1997
Tomographic particle image velocimetry Elsinga, G. E.; Scarano, F.; Wieneke, B. Experiments in Fluids, Vol. 41, Issue 6 https://doi.org/10.1007/s00348-006-0212-z	journal	October 2006
A Convenient Multicamera Self-Calibration for Virtual Environments Svoboda, Tomáš; Martinec, Daniel; Pajdla, Tomáš Presence: Teleoperators and Virtual Environments, Vol. 14, Issue 4 https://doi.org/10.1162/105474605774785325	journal	August 2005
Light Fields and Computational Imaging Levoy, M. Computer, Vol. 39, Issue 8 https://doi.org/10.1109/MC.2006.270	journal	August 2006
Automated Robust Metric Calibration Algorithm for Multifocus Plenoptic Cameras Heinze, Christian; Spyropoulos, Stefano; Hussmann, Stephan IEEE Transactions on Instrumentation and Measurement, Vol. 65, Issue 5 https://doi.org/10.1109/TIM.2015.2507412	journal	May 2016
Uncertainty characterization of particle location from refocused plenoptic images Hall, Elise M.; Guildenbecher, Daniel R.; Thurow, Brian S. Optics Express, Vol. 25, Issue 18 https://doi.org/10.1364/OE.25.021801	journal	January 2017
Three-Dimensional Three-Component Air Flow Visualization in a Steady-State Engine Flow Bench Using a Plenoptic Camera Chen, Hao; Sick, Volker SAE International Journal of Engines, Vol. 10, Issue 2 https://doi.org/10.4271/2017-01-0614	journal	February 2017
The focused plenoptic camera Lumsdaine, Andrew; Georgiev, Todor https://doi.org/10.1109/ICCPHOT.2009.5559008	conference	April 2009
Depth estimation and camera calibration of a focused plenoptic camera for visual odometry Zeller, Niclas; Quint, Franz; Stilla, Uwe ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 118 https://doi.org/10.1016/j.isprsjprs.2016.04.010	journal	August 2016
Single lens stereo with a plenoptic camera Adelson, E. H.; Wang, J. Y. A. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, Issue 2 https://doi.org/10.1109/34.121783	journal	January 1992
Volumetric particle image velocimetry with a single plenoptic camera Fahringer, Timothy W.; Lynch, Kyle P.; Thurow, Brian S. Measurement Science and Technology, Vol. 26, Issue 11 https://doi.org/10.1088/0957-0233/26/11/115201	journal	September 2015
Light-Field Imaging Toolkit Bolan, Jeffrey; Hall, Elise; Clifford, Chris SoftwareX, Vol. 5 https://doi.org/10.1016/j.softx.2016.05.004	journal	January 2016
Volume self-calibration for 3D particle image velocimetry Wieneke, B. Experiments in Fluids, Vol. 45, Issue 4 https://doi.org/10.1007/s00348-008-0521-5	journal	June 2008
Stepwise calibration of focused plenoptic cameras Strobl, Klaus H.; Lingenauber, Martin Computer Vision and Image Understanding, Vol. 145 https://doi.org/10.1016/j.cviu.2015.12.010	journal	April 2016
Comparison of three-dimensional particle tracking and sizing using plenoptic imaging and digital in-line holography Hall, Elise M.; Thurow, Brian S.; Guildenbecher, Daniel R. Applied Optics, Vol. 55, Issue 23 https://doi.org/10.1364/AO.55.006410	journal	January 2016
Filtered refocusing: a volumetric reconstruction algorithm for plenoptic-PIV Fahringer, Timothy W.; Thurow, Brian S. Measurement Science and Technology, Vol. 27, Issue 9 https://doi.org/10.1088/0957-0233/27/9/094005	journal	August 2016
Stereo-PIV using self-calibration on particle images Wieneke, B. Experiments in Fluids, Vol. 39, Issue 2 https://doi.org/10.1007/s00348-005-0962-z	journal	May 2005
In-line holographic particle image velocimetry for turbulent flows Scherer, John O.; Bernal, Luis P. Applied Optics, Vol. 36, Issue 35 https://doi.org/10.1364/AO.36.009309	journal	January 1997
Applications of Holography in Fluid Mechanics and Particle Dynamics Katz, Joseph; Sheng, Jian Annual Review of Fluid Mechanics, Vol. 42, Issue 1 https://doi.org/10.1146/annurev-fluid-121108-145508	journal	January 2010
Digital holography simulations and experiments to quantify the accuracy of 3D particle location and 2D sizing using a proposed hybrid method Guildenbecher, Daniel R.; Gao, Jian; Reu, Phillip L. Applied Optics, Vol. 52, Issue 16 https://doi.org/10.1364/AO.52.003790	journal	January 2013
Holographic particle image velocimetry Hinsch, K. D. Measurement Science and Technology, Vol. 13, Issue 7 https://doi.org/10.1088/0957-0233/13/7/201	journal	June 2002
Using plane + parallax for calibrating dense camera arrays Vaish, V.; Wilburn, B.; Joshi, N. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. https://doi.org/10.1109/cvpr.2004.1315006	conference	January 2004
Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras Dansereau, Donald G.; Pizarro, Oscar; Williams, Stefan B. 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/cvpr.2013.137	conference	June 2013

Cited By (6)

Volumetric calibration enhancements for single-camera light-field PIV Shi, Shengxian; Ding, Junfei; New, T. H. Experiments in Fluids, Vol. 60, Issue 1 https://doi.org/10.1007/s00348-018-2670-5	journal	January 2019
Plenoptic particle image velocimetry with multiple plenoptic cameras Fahringer, Timothy W.; Thurow, Brian S. Measurement Science and Technology, Vol. 29, Issue 7 https://doi.org/10.1088/1361-6501/aabe1d	journal	May 2018
Depth-of-field reduction due to blurring in a relayed plenoptic camera and mitigation via deconvolution Tan, Zu Puayen; Thurow, Brian S. Measurement Science and Technology, Vol. 31, Issue 5 https://doi.org/10.1088/1361-6501/ab614f	journal	January 2020
Three-dimensional extent of flow stagnation in transcatheter heart valves Raghav, Vrishank; Clifford, Chris; Midha, Prem Journal of The Royal Society Interface, Vol. 16, Issue 154 https://doi.org/10.1098/rsif.2019.0063	journal	May 2019
Development and uncertainty characterization of 3D particle location from perspective shifted plenoptic images Hall, Elise Munz; Guildenbecher, Daniel R.; Thurow, Brian S. Optics Express, Vol. 27, Issue 6 https://doi.org/10.1364/oe.27.007997	journal	January 2019
Development of a modular, high-speed plenoptic-camera for 3D flow-measurement Tan, Zu Puayen; Johnson, Kyle; Clifford, Chris Optics Express, Vol. 27, Issue 9 https://doi.org/10.1364/oe.27.013400	journal	January 2019