DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system

Abstract

In this study, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows tomore » effectively recover an accurate, unambiguous, and distortion-free 3D point cloud with only 4 projected patterns. Experimental results verify that our method can achieve high-speed, high-accuracy, robust 3D shape measurement with dense (64-period) fringe patterns at 5000 frames per second.« less

Authors:
 [1];  [1]; ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]; ORCiD logo [1]; ORCiD logo [1]
  1. Nanjing Univ. of Science and Technology, Jiangsu Province (China)
  2. Brookhaven National Lab. (BNL), Upton, NY (United States)
  3. Warsaw Univ. of Technology, Warsaw (Poland)
Publication Date:
Research Org.:
Brookhaven National Lab. (BNL), Upton, NY (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1497384
Report Number(s):
BNL-211310-2019-JAAM
Journal ID: ISSN 1094-4087; OPEXFF
Grant/Contract Number:  
SC0012704
Resource Type:
Accepted Manuscript
Journal Name:
Optics Express
Additional Journal Information:
Journal Volume: 27; Journal Issue: 3; Journal ID: ISSN 1094-4087
Publisher:
Optical Society of America (OSA)
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING

Citation Formats

Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, and Zuo, Chao. High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. United States: N. p., 2019. Web. doi:10.1364/OE.27.002411.
Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, & Zuo, Chao. High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. United States. https://doi.org/10.1364/OE.27.002411
Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, and Zuo, Chao. Fri . "High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system". United States. https://doi.org/10.1364/OE.27.002411. https://www.osti.gov/servlets/purl/1497384.
@article{osti_1497384,
title = {High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system},
author = {Yin, Wei and Feng, Shijie and Tao, Tianyang and Huang, Lei and Trusiak, Maciej and Chen, Qian and Zuo, Chao},
abstractNote = {In this study, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows to effectively recover an accurate, unambiguous, and distortion-free 3D point cloud with only 4 projected patterns. Experimental results verify that our method can achieve high-speed, high-accuracy, robust 3D shape measurement with dense (64-period) fringe patterns at 5000 frames per second.},
doi = {10.1364/OE.27.002411},
journal = {Optics Express},
number = 3,
volume = 27,
place = {United States},
year = {Fri Jan 25 00:00:00 EST 2019},
month = {Fri Jan 25 00:00:00 EST 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 71 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: The principle of Zhang’s method [36]. (a) The three-step phase-shifting patterns. (b) The speckle pattern. (c) The intensity of the speckle signal in conventional three-step phase-shifting patterns. (d) The three-step speckle-embedded phase-shifting patterns. (e) The embedded speckle pattern.

Save / Share:

Works referenced in this record:

Reliability-guided phase unwrapping algorithm: a review
journal, September 2004


Unambiguous 3D measurement from speckle-embedded fringe
journal, January 2013


Phase shifting algorithms for fringe projection profilometry: A review
journal, October 2018


Graphics processing unit–assisted real-time three-dimensional measurement using speckle-embedded fringe
journal, January 2015


Flexible 3-D shape measurement using projector defocusing
journal, January 2009


Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects
journal, January 2013


Two-dimensional phase unwrapping with minimum weighted discontinuity
journal, January 1997


High-speed absolute three-dimensional shape measurement using three binary dithered patterns
journal, January 2014


Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system
journal, January 2016


Fast phase measurement profilometry for arbitrary shape objects without phase unwrapping
journal, November 2013


Minimum Lp-norm two-dimensional phase unwrapping
journal, January 1996

  • Ghiglia, Dennis C.; Romero, Louis A.
  • Journal of the Optical Society of America A, Vol. 13, Issue 10
  • DOI: 10.1364/JOSAA.13.001999

Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination
journal, November 2011

  • Wang, Yongchang; Liu, Kai; Hao, Qi
  • IEEE Transactions on Image Processing, Vol. 20, Issue 11
  • DOI: 10.1109/TIP.2011.2155072

Automated phase-measuring profilometry of 3-D diffuse objects
journal, January 1984

  • Srinivasan, V.; Liu, H. C.; Halioua, M.
  • Applied Optics, Vol. 23, Issue 18
  • DOI: 10.1364/AO.23.003105

High-precision real-time 3D shape measurement based on a quad-camera system
journal, December 2017


A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system
journal, January 2013

  • Zhang, Zonghua; Huang, Shujun; Meng, Shasha
  • Optics Express, Vol. 21, Issue 10
  • DOI: 10.1364/OE.21.012218

High-speed and high-accuracy 3D surface measurement using a mechanical projector
journal, January 2018

  • Hyun, Jae-Sang; Chiu, George T. -C.; Zhang, Song
  • Optics Express, Vol. 26, Issue 2
  • DOI: 10.1364/OE.26.001474

Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies
journal, January 2011


High dynamic range 3D measurements with fringe projection profilometry: a review
journal, November 2018

  • Feng, Shijie; Zhang, Liang; Zuo, Chao
  • Measurement Science and Technology, Vol. 29, Issue 12
  • DOI: 10.1088/1361-6501/aae4fb

General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique
journal, August 2014


Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems
journal, September 2012

  • Garcia, Ricardo R.; Zakhor, Avideh
  • IEEE Journal of Selected Topics in Signal Processing, Vol. 6, Issue 5
  • DOI: 10.1109/JSTSP.2012.2195157

High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping
journal, April 2019


GOBO projection for 3D measurements at highest frame rates: a performance analysis
journal, October 2018

  • Heist, Stefan; Dietrich, Patrick; Landmann, Martin
  • Light: Science & Applications, Vol. 7, Issue 1
  • DOI: 10.1038/s41377-018-0072-3

Real-time microscopic 3D shape measurement based on optimized pulse-width-modulation binary fringe projection
journal, June 2017


Micro Fourier Transform Profilometry ( μ FTP): 3D shape measurement at 10,000 frames per second
journal, March 2018


Three-dimensional shape measurement with binary dithered patterns
journal, January 2012


Optical 3-D surface reconstruction with color binary speckle pattern encoding
journal, January 2018

  • Zhou, Pei; Zhu, Jiangping; Jing, Hailong
  • Optics Express, Vol. 26, Issue 3
  • DOI: 10.1364/OE.26.003452

High-speed 3D shape measurement with structured light methods: A review
journal, July 2018


Fringe projection techniques: Whither we are?
journal, February 2010


Robust dynamic 3-D measurements with motion-compensated phase-shifting profilometry
journal, April 2018


Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques
journal, August 2012


Genetic method to optimize binary dithering technique for high-quality fringe generation
journal, January 2013


Pixel-wise absolute phase unwrapping using geometric constraints of structured light system
journal, January 2016

  • An, Yatong; Hyun, Jae-Sang; Zhang, Song
  • Optics Express, Vol. 24, Issue 16
  • DOI: 10.1364/OE.24.018445

High-speed three-dimensional profilometry for multiple objects with complex shapes
journal, January 2012


Fast 3D shape measurement using Fourier transform profilometry without phase unwrapping
journal, September 2016


High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection
journal, August 2013


Novel phase-coding method for absolute phase retrieval
journal, January 2012


Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review
journal, October 2016


Fourier transform profilometry:
journal, May 2001


Fourier transform profilometry for the automatic measurement of 3-D object shapes
journal, January 1983


Structured light field 3D imaging
journal, January 2016


Mean intensity gradient: An effective global parameter for quality assessment of the speckle patterns used in digital image correlation
journal, April 2010


Flexible phase error compensation based on Hilbert transform in phase shifting profilometry
journal, January 2015


Dual-frequency pattern scheme for high-speed 3-D shape measurement
journal, January 2010

  • Liu, Kai; Wang, Yongchang; Lau, Daniel L.
  • Optics Express, Vol. 18, Issue 5
  • DOI: 10.1364/OE.18.005229

Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors
journal, January 1999

  • Sansoni, Giovanna; Carocci, Matteo; Rodella, Roberto
  • Applied Optics, Vol. 38, Issue 31
  • DOI: 10.1364/AO.38.006565

Dynamic 3-D shape measurement method: A review
journal, February 2010


Works referencing / citing this record:

Temporal phase unwrapping using deep learning
journal, December 2019


Dual-projector structured light 3D shape measurement
journal, January 2020

  • Yu, Ying; Lau, Daniel L.; Ruffner, Matthew P.
  • Applied Optics, Vol. 59, Issue 4
  • DOI: 10.1364/ao.378363

Calibration method for panoramic 3D shape measurement with plane mirrors
journal, January 2019


Dynamic 3-D shape measurement in an unlimited depth range based on adaptive pixel-by-pixel phase unwrapping
journal, January 2020

  • Duan, Minghui; Jin, Yi; Chen, Huaian
  • Optics Express, Vol. 28, Issue 10
  • DOI: 10.1364/oe.391777

Temporal phase unwrapping using deep learning
preprint, January 2019