High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system
Abstract
In this study, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows tomore »
- Authors:
-
- Nanjing Univ. of Science and Technology, Jiangsu Province (China)
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Warsaw Univ. of Technology, Warsaw (Poland)
- Publication Date:
- Research Org.:
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES)
- OSTI Identifier:
- 1497384
- Report Number(s):
- BNL-211310-2019-JAAM
Journal ID: ISSN 1094-4087; OPEXFF
- Grant/Contract Number:
- SC0012704
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Optics Express
- Additional Journal Information:
- Journal Volume: 27; Journal Issue: 3; Journal ID: ISSN 1094-4087
- Publisher:
- Optical Society of America (OSA)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING
Citation Formats
Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, and Zuo, Chao. High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. United States: N. p., 2019.
Web. doi:10.1364/OE.27.002411.
Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, & Zuo, Chao. High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. United States. https://doi.org/10.1364/OE.27.002411
Yin, Wei, Feng, Shijie, Tao, Tianyang, Huang, Lei, Trusiak, Maciej, Chen, Qian, and Zuo, Chao. Fri .
"High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system". United States. https://doi.org/10.1364/OE.27.002411. https://www.osti.gov/servlets/purl/1497384.
@article{osti_1497384,
title = {High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system},
author = {Yin, Wei and Feng, Shijie and Tao, Tianyang and Huang, Lei and Trusiak, Maciej and Chen, Qian and Zuo, Chao},
abstractNote = {In this study, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows to effectively recover an accurate, unambiguous, and distortion-free 3D point cloud with only 4 projected patterns. Experimental results verify that our method can achieve high-speed, high-accuracy, robust 3D shape measurement with dense (64-period) fringe patterns at 5000 frames per second.},
doi = {10.1364/OE.27.002411},
journal = {Optics Express},
number = 3,
volume = 27,
place = {United States},
year = {Fri Jan 25 00:00:00 EST 2019},
month = {Fri Jan 25 00:00:00 EST 2019}
}
Web of Science
Figures / Tables:
Works referenced in this record:
Reliability-guided phase unwrapping algorithm: a review
journal, September 2004
- Su, Xianyu; Chen, Wenjing
- Optics and Lasers in Engineering, Vol. 42, Issue 3
Unambiguous 3D measurement from speckle-embedded fringe
journal, January 2013
- Zhang, Yueyi; Xiong, Zhiwei; Wu, Feng
- Applied Optics, Vol. 52, Issue 32
High-frequency background modulation fringe patterns based on a fringe-wavelength geometry-constraint model for 3D surface-shape measurement
journal, January 2017
- Liu, Xinran; Kofman, Jonathan
- Optics Express, Vol. 25, Issue 14
Phase shifting algorithms for fringe projection profilometry: A review
journal, October 2018
- Zuo, Chao; Feng, Shijie; Huang, Lei
- Optics and Lasers in Engineering, Vol. 109
Graphics processing unit–assisted real-time three-dimensional measurement using speckle-embedded fringe
journal, January 2015
- Feng, Shijie; Chen, Qian; Zuo, Chao
- Applied Optics, Vol. 54, Issue 22
Flexible 3-D shape measurement using projector defocusing
journal, January 2009
- Lei, Shuangyan; Zhang, Song
- Optics Letters, Vol. 34, Issue 20
Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects
journal, January 2013
- Li, Zhongwei; Zhong, Kai; Li, Y. F.
- Optics Letters, Vol. 38, Issue 9
Two-dimensional phase unwrapping with minimum weighted discontinuity
journal, January 1997
- Flynn, Thomas J.
- Journal of the Optical Society of America A, Vol. 14, Issue 10
High-speed absolute three-dimensional shape measurement using three binary dithered patterns
journal, January 2014
- Lohry, William; Zhang, Song
- Optics Express, Vol. 22, Issue 22
Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system
journal, January 2016
- Tao, Tianyang; Chen, Qian; Da, Jian
- Optics Express, Vol. 24, Issue 18
Fast phase measurement profilometry for arbitrary shape objects without phase unwrapping
journal, November 2013
- Zhong, Kai; Li, Zhongwei; Shi, Yusheng
- Optics and Lasers in Engineering, Vol. 51, Issue 11
Minimum Lp-norm two-dimensional phase unwrapping
journal, January 1996
- Ghiglia, Dennis C.; Romero, Louis A.
- Journal of the Optical Society of America A, Vol. 13, Issue 10
Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination
journal, November 2011
- Wang, Yongchang; Liu, Kai; Hao, Qi
- IEEE Transactions on Image Processing, Vol. 20, Issue 11
Automated phase-measuring profilometry of 3-D diffuse objects
journal, January 1984
- Srinivasan, V.; Liu, H. C.; Halioua, M.
- Applied Optics, Vol. 23, Issue 18
High-precision real-time 3D shape measurement based on a quad-camera system
journal, December 2017
- Tao, Tianyang; Chen, Qian; Feng, Shijie
- Journal of Optics, Vol. 20, Issue 1
A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system
journal, January 2013
- Zhang, Zonghua; Huang, Shujun; Meng, Shasha
- Optics Express, Vol. 21, Issue 10
High-speed and high-accuracy 3D surface measurement using a mechanical projector
journal, January 2018
- Hyun, Jae-Sang; Chiu, George T. -C.; Zhang, Song
- Optics Express, Vol. 26, Issue 2
Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies
journal, January 2011
- Zhao, Ming; Huang, Lei; Zhang, Qican
- Applied Optics, Vol. 50, Issue 33
High dynamic range 3D measurements with fringe projection profilometry: a review
journal, November 2018
- Feng, Shijie; Zhang, Liang; Zuo, Chao
- Measurement Science and Technology, Vol. 29, Issue 12
General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique
journal, August 2014
- Feng, Shijie; Zhang, Yuzhen; Chen, Qian
- Optics and Lasers in Engineering, Vol. 59
Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems
journal, September 2012
- Garcia, Ricardo R.; Zakhor, Avideh
- IEEE Journal of Selected Topics in Signal Processing, Vol. 6, Issue 5
High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping
journal, April 2019
- Yin, Wei; Zuo, Chao; Feng, Shijie
- Optics and Lasers in Engineering, Vol. 115
GOBO projection for 3D measurements at highest frame rates: a performance analysis
journal, October 2018
- Heist, Stefan; Dietrich, Patrick; Landmann, Martin
- Light: Science & Applications, Vol. 7, Issue 1
Real-time microscopic 3D shape measurement based on optimized pulse-width-modulation binary fringe projection
journal, June 2017
- Hu, Yan; Chen, Qian; Feng, Shijie
- Measurement Science and Technology, Vol. 28, Issue 7
Micro Fourier Transform Profilometry ( μ FTP): 3D shape measurement at 10,000 frames per second
journal, March 2018
- Zuo, Chao; Tao, Tianyang; Feng, Shijie
- Optics and Lasers in Engineering, Vol. 102
Three-dimensional shape measurement with binary dithered patterns
journal, January 2012
- Wang, Yajun; Zhang, Song
- Applied Optics, Vol. 51, Issue 27
Optical 3-D surface reconstruction with color binary speckle pattern encoding
journal, January 2018
- Zhou, Pei; Zhu, Jiangping; Jing, Hailong
- Optics Express, Vol. 26, Issue 3
High-speed 3D shape measurement with structured light methods: A review
journal, July 2018
- Zhang, Song
- Optics and Lasers in Engineering, Vol. 106
Fringe projection techniques: Whither we are?
journal, February 2010
- Gorthi, Sai Siva; Rastogi, Pramod
- Optics and Lasers in Engineering, Vol. 48, Issue 2
Robust dynamic 3-D measurements with motion-compensated phase-shifting profilometry
journal, April 2018
- Feng, Shijie; Zuo, Chao; Tao, Tianyang
- Optics and Lasers in Engineering, Vol. 103
Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques
journal, August 2012
- Zhang, Z. H.
- Optics and Lasers in Engineering, Vol. 50, Issue 8
Genetic method to optimize binary dithering technique for high-quality fringe generation
journal, January 2013
- Lohry, William; Zhang, Song
- Optics Letters, Vol. 38, Issue 4
Pixel-wise absolute phase unwrapping using geometric constraints of structured light system
journal, January 2016
- An, Yatong; Hyun, Jae-Sang; Zhang, Song
- Optics Express, Vol. 24, Issue 16
High-speed three-dimensional profilometry for multiple objects with complex shapes
journal, January 2012
- Zuo, Chao; Chen, Qian; Gu, Guohua
- Optics Express, Vol. 20, Issue 17
Fast 3D shape measurement using Fourier transform profilometry without phase unwrapping
journal, September 2016
- Song, Kechen; Hu, Shaopeng; Wen, Xin
- Optics and Lasers in Engineering, Vol. 84
High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection
journal, August 2013
- Zuo, Chao; Chen, Qian; Gu, Guohua
- Optics and Lasers in Engineering, Vol. 51, Issue 8
Novel phase-coding method for absolute phase retrieval
journal, January 2012
- Wang, Yajun; Zhang, Song
- Optics Letters, Vol. 37, Issue 11
Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review
journal, October 2016
- Zuo, Chao; Huang, Lei; Zhang, Minliang
- Optics and Lasers in Engineering, Vol. 85
Fourier transform profilometry:
journal, May 2001
- Su, Xianyu; Chen, Wenjing
- Optics and Lasers in Engineering, Vol. 35, Issue 5
Fourier transform profilometry for the automatic measurement of 3-D object shapes
journal, January 1983
- Takeda, Mitsuo; Mutoh, Kazuhiro
- Applied Optics, Vol. 22, Issue 24
Structured light field 3D imaging
journal, January 2016
- Cai, Zewei; Liu, Xiaoli; Peng, Xiang
- Optics Express, Vol. 24, Issue 18
Mean intensity gradient: An effective global parameter for quality assessment of the speckle patterns used in digital image correlation
journal, April 2010
- Pan, Bing; Lu, Zixing; Xie, Huimin
- Optics and Lasers in Engineering, Vol. 48, Issue 4
Flexible phase error compensation based on Hilbert transform in phase shifting profilometry
journal, January 2015
- Cai, Zewei; Liu, Xiaoli; Jiang, Hao
- Optics Express, Vol. 23, Issue 19
Dual-frequency pattern scheme for high-speed 3-D shape measurement
journal, January 2010
- Liu, Kai; Wang, Yongchang; Lau, Daniel L.
- Optics Express, Vol. 18, Issue 5
Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors
journal, January 1999
- Sansoni, Giovanna; Carocci, Matteo; Rodella, Roberto
- Applied Optics, Vol. 38, Issue 31
Dynamic 3-D shape measurement method: A review
journal, February 2010
- Su, Xianyu; Zhang, Qican
- Optics and Lasers in Engineering, Vol. 48, Issue 2
Works referencing / citing this record:
Temporal phase unwrapping using deep learning
journal, December 2019
- Yin, Wei; Chen, Qian; Feng, Shijie
- Scientific Reports, Vol. 9, Issue 1
Dual-projector structured light 3D shape measurement
journal, January 2020
- Yu, Ying; Lau, Daniel L.; Ruffner, Matthew P.
- Applied Optics, Vol. 59, Issue 4
Calibration method for panoramic 3D shape measurement with plane mirrors
journal, January 2019
- Yin, Wei; Feng, Shijie; Tao, Tianyang
- Optics Express, Vol. 27, Issue 25
Dynamic 3-D shape measurement in an unlimited depth range based on adaptive pixel-by-pixel phase unwrapping
journal, January 2020
- Duan, Minghui; Jin, Yi; Chen, Huaian
- Optics Express, Vol. 28, Issue 10
Temporal phase unwrapping using deep learning
preprint, January 2019
- Yin, Wei; Chen, Qian; Feng, Shijie
- arXiv
Figures / Tables found in this record: