Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10,000 frames per second

Journal Article · · Optics and Lasers in Engineering
 [1];  [1];  [1];  [2];  [3];  [4]
  1. Nanjing University of Science and Technology (China). Smart Computational Imaging (SCI) Laboratory and Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense
  2. Brookhaven National Lab. (BNL), Upton, NY (United States). National Synchrotron Light Source II (NSLS-II)
  3. Nanyang Technological University (Singapore). Centre for Optical and Laser Engineering (COLE), School of Mechanical and Aerospace Engineering
  4. Nanjing University of Science and Technology (China). Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense

We report that fringe projection profilometry is a well-established technique for optical 3D shape measurement. However, in many applications, it is desirable to make 3D measurements at very high speed, especially with fast moving or shape changing objects. In this work, we demonstrate a new 3D dynamic imaging technique, Micro Fourier Transform Profilometry (μFTP), which can realize an acquisition rate up to 10,000 3D frame per second (fps). The high measurement speed is achieved by the number of patterns reduction as well as high-speed fringe projection hardware. In order to capture 3D information in such a short period of time, we focus on the improvement of the phase recovery, phase unwrapping, and error compensation algorithms, allowing to reconstruct an accurate, unambiguous, and distortion-free 3D point cloud with every two projected patterns. We also develop a high-frame-rate fringe projection hardware by pairing a high-speed camera and a DLP projector, enabling binary pattern switching and precisely synchronized image capture at a frame rate up to 20,000 fps. Lastly, based on this system, we demonstrate high-quality textured 3D imaging of 4 transient scenes: vibrating cantilevers, rotating fan blades, flying bullet, and bursting balloon, which were previously difficult or even unable to be captured with conventional approaches.

Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22)
Grant/Contract Number:
SC0012704
OSTI ID:
1426465
Report Number(s):
BNL--203359-2018-JAAM
Journal Information:
Optics and Lasers in Engineering, Journal Name: Optics and Lasers in Engineering Journal Issue: C Vol. 102; ISSN 0143-8166
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (89)

Fringe projection techniques: Whither we are? journal February 2010
Localization of inner hair cell mechanotransducer channels using high-speed calcium imaging journal March 2009
Time-resolved imaging of purely valence-electron dynamics during a chemical reaction journal April 2011
Robust Structured Light Coding for 3D Reconstruction conference January 2007
Lock-in Time-of-Flight (ToF) Cameras: A Survey journal September 2011
Fourier transform profilometry for the automatic measurement of 3-D object shapes journal January 1983
CMOS Image Sensors for High Speed Applications journal January 2009
Simultaneous whole-animal 3D-imaging of neuronal activity using light field microscopy text January 2014
Assessment of High Speed Imaging Systems for 2D and 3D Deformation Measurements: Methodology Development and Validation journal January 2007
Automatic processing of fringe patterns in integer interferometers journal January 1991
Fourier transform profilometry: journal May 2001
The effect of windowing in Fourier transform profilometry applied to noisy images journal June 2004
A survey on industrial vision systems, applications and tools journal February 2003
Vehicle crash accident reconstruction based on the analysis 3D deformation of the auto-body journal June 2008
Efficient multiple phase shift patterns for dense 3D acquisition in structured light scanning journal August 2010
Reliability-guided phase unwrapping algorithm: a review journal September 2004
Recent progresses on real-time 3D shape measurement using digital fringe projection techniques journal February 2010
Dynamic 3-D shape measurement method: A review journal February 2010
Fourier transform profilometry (FTP) using an innovative band-pass filter for accurate 3-D surface reconstruction journal February 2010
Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques journal August 2012
High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection journal August 2013
Real-time structured light profilometry: a review journal December 2016
High-speed three-dimensional shape measurement using GOBO projection journal December 2016
Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review journal October 2016
Temporal phase unwrapping using orthographic projection journal March 2017
Pattern codification strategies in structured light systems journal April 2004
A state of the art in structured light patterns for surface profilometry journal August 2010
High-speed photography journal June 1981
Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena journal April 2009
Single-shot compressed ultrafast photography at one hundred billion frames per second journal December 2014
Super-resolution 3D microscopy of live whole cells using structured illumination journal October 2011
Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy journal May 2014
Tomographic phase microscopy journal August 2007
Mapping the world in 3D journal July 2010
Sequentially timed all-optical mapping photography (STAMP) journal August 2014
DMD-based LED-illumination Super-resolution and optical sectioning microscopy journal January 2013
Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. SHORT COMMUNICATION journal May 2000
High-speed photography journal September 1983
Confocal optical microscopy journal March 1996
Geometric camera calibration using circular control points journal January 2000
Lock-in Time-of-Flight (ToF) Cameras: A Survey journal September 2011
Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination journal November 2011
High-speed 3-D shape measurement based on digital fringe projection journal January 2003
Optical 3-D shape and deformation measurement of rotating blades using stroboscopic structured illumination journal November 2005
Multiresolution three-dimensional measurement system with multiple cameras and light sectioning method journal December 2010
Fast data acquisition for three-dimensional shape measurement using fixed-pattern projection and temporal coding journal October 2011
Automatic identification and removal of outliers for high-speed fringe projection profilometry journal January 2013
Statistical patterns: an approach for high-speed and high-accuracy shape measurements journal April 2014
Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement journal May 2014
High-speed three-dimensional measurements with a fringe projection-based optical sensor journal June 2014
Two-dimensional Fourier transform profilometry for the automatic measurement of three-dimensional object shapes journal November 1995
Emerging digital micromirror device (DMD) applications conference January 2003
Improved Fourier transform profilometry for the automatic measurement of 3D object shapes journal January 1990
3D Computational Imaging with Single-Pixel Detectors journal May 2013
Slow art with a trillion frames per second camera conference January 2011
An introduction to high speed photography and photonics journal December 2009
Reliability of Landing 3D Motion Analysis: Implications for Longitudinal Analyses journal January 2007
Fourier transform profilometry for the automatic measurement of 3-D object shapes journal January 1983
Automated phase-measuring profilometry of 3-D diffuse objects journal January 1984
Two-wavelength phase shifting interferometry journal January 1984
Step height measurement using two-wavelength phase-shifting interferometry journal January 1987
Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors journal January 1999
Fast two-dimensional phase-unwrapping algorithm based on sorting by reliability following a noncontinuous path journal January 2002
Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies journal January 2011
Optimized pulse width modulation pattern strategy for three-dimensional profilometry with projector defocusing journal January 2012
Three-dimensional shape measurement with binary dithered patterns journal January 2012
Unambiguous 3D measurement from speckle-embedded fringe journal January 2013
Real-time, high-accuracy 3D imaging and shape measurement journal November 2014
Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement journal January 2015
High-precision real-time 3D shape measurement using a bi-frequency scheme and multi-view system journal January 2017
Structured-light 3D surface imaging: a tutorial journal January 2011
Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency Selection journal January 2006
Dual-frequency pattern scheme for high-speed 3-D shape measurement journal January 2010
Superfast multifrequency phase-shifting technique with optimal pulse width modulation journal January 2011
High-speed three-dimensional profilometry for multiple objects with complex shapes journal January 2012
Pixel-wise absolute phase unwrapping using geometric constraints of structured light system journal January 2016
Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system journal January 2016
Motion-induced error reduction by combining Fourier transform profilometry with phase-shifting profilometry journal January 2016
Motion-oriented high speed 3-D measurements by binocular fringe projection using binary aperiodic patterns journal January 2017
Flexible 3-D shape measurement using projector defocusing journal January 2009
Real-time three-dimensional shape measurement of moving objects without edge errors by time-synchronized structured illumination journal January 2010
High-speed three-dimensional shape measurements of objects with laser speckles and acousto-optical deflection journal January 2011
Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects journal January 2013
Camera calibration with active phase target: improvement on feature detection and optimization journal January 2013
High-speed three-dimensional shape measurements of objects with laser speckles and acousto-optical deflection collection January 2011
Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects collection January 2013
Dual-frequency pattern scheme for high-speed 3-D shape measurement collection January 2017
High-speed three-dimensional profilometry for multiple objects with complex shapes collection January 2012
Motion-oriented high speed 3-D measurements by binocular fringe projection using binary aperiodic patterns collection January 2017

Cited By (21)

Temporal phase unwrapping using deep learning journal December 2019
3D Measurement of Human Chest and Abdomen Surface Based on 3D Fourier Transform and Time Phase Unwrapping journal February 2020
A simple and practical jump error removal method for fringe projection profilometry based on self-alignment technique journal December 2018
High dynamic range 3D measurements with fringe projection profilometry: a review journal November 2018
Dynamic 3D measurement of thermal deformation based on geometric-constrained stereo-matching with a stereo microscopic system journal September 2019
Dynamic microscopic 3D shape measurement based on marker-embedded Fourier transform profilometry journal January 2018
Optimal wavelength selection strategy in temporal phase unwrapping with projection distance minimization journal January 2018
High-speed stereo-digital image correlation using a single color high-speed camera journal January 2018
Key concepts for phase-to-coordinate conversion in fringe projection systems journal January 2019
Real-time 3D shape measurement using 3LCD projection and deep machine learning journal January 2019
High-speed real-time 3D shape measurement based on adaptive depth constraint journal January 2018
High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light journal January 2019
High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system journal January 2019
Motion-artifact-free dynamic 3D shape measurement with hybrid Fourier-transform phase-shifting profilometry journal January 2019
High-speed three-dimensional shape measurement based on shifting Gray-code light journal January 2019
Real-time motion-induced-error compensation in 3D surface-shape measurement journal January 2019
Calibration method for panoramic 3D shape measurement with plane mirrors journal January 2019
Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning journal January 2020
Single-shot absolute 3D shape measurement with deep-learning-based color fringe projection profilometry journal January 2020
Temporal phase unwrapping using deep learning preprint January 2019
Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning text January 2019

Figures / Tables (11)


Similar Records

Improved Fourier-transform profilometry
Journal Article · Fri Feb 09 23:00:00 EST 2007 · Applied Optics · OSTI ID:20929601

High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping
Journal Article · Thu Nov 22 23:00:00 EST 2018 · Optics and Lasers in Engineering · OSTI ID:1497385

Method and system for unsynchronized structured lighting
Patent · Tue Aug 23 00:00:00 EDT 2022 · OSTI ID:1925024