DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Volumetric calibration of a plenoptic camera

Abstract

Here, the volumetric calibration of a plenoptic camera is explored to correct for inaccuracies due to real-world lens distortions and thin-lens assumptions in current processing methods. Two methods of volumetric calibration based on a polynomial mapping function that does not require knowledge of specific lens parameters are presented and compared to a calibration based on thin-lens assumptions. The first method, volumetric dewarping, is executed by creation of a volumetric representation of a scene using the thin-lens assumptions, which is then corrected in post-processing using a polynomial mapping function. The second method, direct light-field calibration, uses the polynomial mapping in creation of the initial volumetric representation to relate locations in object space directly to image sensor locations. The accuracy and feasibility of these methods is examined experimentally by capturing images of a known dot card at a variety of depths. Results suggest that use of a 3D polynomial mapping function provides a significant increase in reconstruction accuracy and that the achievable accuracy is similar using either polynomial-mapping-based method. Additionally, direct light-field calibration provides significant computational benefits by eliminating some intermediate processing steps found in other methods. Finally, the flexibility of this method is shown for a nonplanar calibration.

Authors:
 [1];  [2];  [3];  [2]
  1. Auburn Univ., Auburn, AL (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Auburn Univ., Auburn, AL (United States)
  3. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1421765
Alternate Identifier(s):
OSTI ID: 1418726
Report Number(s):
SAND-2018-0806J
Journal ID: ISSN 1559-128X; APOPAI; 660487
Grant/Contract Number:  
AC04-94AL85000; NA0003525
Resource Type:
Accepted Manuscript
Journal Name:
Applied Optics
Additional Journal Information:
Journal Volume: 57; Journal Issue: 4; Journal ID: ISSN 1559-128X
Publisher:
Optical Society of America
Country of Publication:
United States
Language:
English
Subject:
47 OTHER INSTRUMENTATION; three-dimensional image processing; three-dimensional image acquisition

Citation Formats

Hall, Elise Munz, Fahringer, Timothy W., Guildenbecher, Daniel Robert, and Thurow, Brian S. Volumetric calibration of a plenoptic camera. United States: N. p., 2018. Web. doi:10.1364/AO.57.000914.
Hall, Elise Munz, Fahringer, Timothy W., Guildenbecher, Daniel Robert, & Thurow, Brian S. Volumetric calibration of a plenoptic camera. United States. https://doi.org/10.1364/AO.57.000914
Hall, Elise Munz, Fahringer, Timothy W., Guildenbecher, Daniel Robert, and Thurow, Brian S. Thu . "Volumetric calibration of a plenoptic camera". United States. https://doi.org/10.1364/AO.57.000914. https://www.osti.gov/servlets/purl/1421765.
@article{osti_1421765,
title = {Volumetric calibration of a plenoptic camera},
author = {Hall, Elise Munz and Fahringer, Timothy W. and Guildenbecher, Daniel Robert and Thurow, Brian S.},
abstractNote = {Here, the volumetric calibration of a plenoptic camera is explored to correct for inaccuracies due to real-world lens distortions and thin-lens assumptions in current processing methods. Two methods of volumetric calibration based on a polynomial mapping function that does not require knowledge of specific lens parameters are presented and compared to a calibration based on thin-lens assumptions. The first method, volumetric dewarping, is executed by creation of a volumetric representation of a scene using the thin-lens assumptions, which is then corrected in post-processing using a polynomial mapping function. The second method, direct light-field calibration, uses the polynomial mapping in creation of the initial volumetric representation to relate locations in object space directly to image sensor locations. The accuracy and feasibility of these methods is examined experimentally by capturing images of a known dot card at a variety of depths. Results suggest that use of a 3D polynomial mapping function provides a significant increase in reconstruction accuracy and that the achievable accuracy is similar using either polynomial-mapping-based method. Additionally, direct light-field calibration provides significant computational benefits by eliminating some intermediate processing steps found in other methods. Finally, the flexibility of this method is shown for a nonplanar calibration.},
doi = {10.1364/AO.57.000914},
journal = {Applied Optics},
number = 4,
volume = 57,
place = {United States},
year = {Thu Feb 01 00:00:00 EST 2018},
month = {Thu Feb 01 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 25 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: Schematic depicting plenoptic imaging.

Save / Share:

Works referenced in this record:

Calibration and accuracy analysis of a focused plenoptic camera
journal, January 2014

  • Zeller, N.; Quint, F.; Stilla, U.
  • ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. II-3
  • DOI: 10.5194/isprsannals-II-3-205-2014

Tomographic PIV: principles and practice
journal, October 2012


Distortion compensation for generalized stereoscopic particle image velocimetry
journal, December 1997


Tomographic particle image velocimetry
journal, October 2006


A Convenient Multicamera Self-Calibration for Virtual Environments
journal, August 2005

  • Svoboda, Tomáš; Martinec, Daniel; Pajdla, Tomáš
  • Presence: Teleoperators and Virtual Environments, Vol. 14, Issue 4
  • DOI: 10.1162/105474605774785325

Light Fields and Computational Imaging
journal, August 2006


Automated Robust Metric Calibration Algorithm for Multifocus Plenoptic Cameras
journal, May 2016

  • Heinze, Christian; Spyropoulos, Stefano; Hussmann, Stephan
  • IEEE Transactions on Instrumentation and Measurement, Vol. 65, Issue 5
  • DOI: 10.1109/TIM.2015.2507412

Uncertainty characterization of particle location from refocused plenoptic images
journal, January 2017

  • Hall, Elise M.; Guildenbecher, Daniel R.; Thurow, Brian S.
  • Optics Express, Vol. 25, Issue 18
  • DOI: 10.1364/OE.25.021801

Three-Dimensional Three-Component Air Flow Visualization in a Steady-State Engine Flow Bench Using a Plenoptic Camera
journal, February 2017

  • Chen, Hao; Sick, Volker
  • SAE International Journal of Engines, Vol. 10, Issue 2
  • DOI: 10.4271/2017-01-0614

The focused plenoptic camera
conference, April 2009


Depth estimation and camera calibration of a focused plenoptic camera for visual odometry
journal, August 2016


Single lens stereo with a plenoptic camera
journal, January 1992

  • Adelson, E. H.; Wang, J. Y. A.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, Issue 2
  • DOI: 10.1109/34.121783

Volumetric particle image velocimetry with a single plenoptic camera
journal, September 2015


Light-Field Imaging Toolkit
journal, January 2016


Volume self-calibration for 3D particle image velocimetry
journal, June 2008


Stepwise calibration of focused plenoptic cameras
journal, April 2016


Comparison of three-dimensional particle tracking and sizing using plenoptic imaging and digital in-line holography
journal, January 2016

  • Hall, Elise M.; Thurow, Brian S.; Guildenbecher, Daniel R.
  • Applied Optics, Vol. 55, Issue 23
  • DOI: 10.1364/AO.55.006410

Filtered refocusing: a volumetric reconstruction algorithm for plenoptic-PIV
journal, August 2016


Stereo-PIV using self-calibration on particle images
journal, May 2005


In-line holographic particle image velocimetry for turbulent flows
journal, January 1997


Applications of Holography in Fluid Mechanics and Particle Dynamics
journal, January 2010


Digital holography simulations and experiments to quantify the accuracy of 3D particle location and 2D sizing using a proposed hybrid method
journal, January 2013

  • Guildenbecher, Daniel R.; Gao, Jian; Reu, Phillip L.
  • Applied Optics, Vol. 52, Issue 16
  • DOI: 10.1364/AO.52.003790

Holographic particle image velocimetry
journal, June 2002


Using plane + parallax for calibrating dense camera arrays
conference, January 2004

  • Vaish, V.; Wilburn, B.; Joshi, N.
  • Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
  • DOI: 10.1109/cvpr.2004.1315006

Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
conference, June 2013

  • Dansereau, Donald G.; Pizarro, Oscar; Williams, Stefan B.
  • 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • DOI: 10.1109/cvpr.2013.137

Works referencing / citing this record:

Volumetric calibration enhancements for single-camera light-field PIV
journal, January 2019


Plenoptic particle image velocimetry with multiple plenoptic cameras
journal, May 2018

  • Fahringer, Timothy W.; Thurow, Brian S.
  • Measurement Science and Technology, Vol. 29, Issue 7
  • DOI: 10.1088/1361-6501/aabe1d

Depth-of-field reduction due to blurring in a relayed plenoptic camera and mitigation via deconvolution
journal, January 2020


Three-dimensional extent of flow stagnation in transcatheter heart valves
journal, May 2019

  • Raghav, Vrishank; Clifford, Chris; Midha, Prem
  • Journal of The Royal Society Interface, Vol. 16, Issue 154
  • DOI: 10.1098/rsif.2019.0063

Development and uncertainty characterization of 3D particle location from perspective shifted plenoptic images
journal, January 2019

  • Hall, Elise Munz; Guildenbecher, Daniel R.; Thurow, Brian S.
  • Optics Express, Vol. 27, Issue 6
  • DOI: 10.1364/oe.27.007997

Development of a modular, high-speed plenoptic-camera for 3D flow-measurement
journal, January 2019

  • Tan, Zu Puayen; Johnson, Kyle; Clifford, Chris
  • Optics Express, Vol. 27, Issue 9
  • DOI: 10.1364/oe.27.013400