skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10,000 frames per second

Journal Article · · Optics and Lasers in Engineering
 [1];  [1];  [1];  [2];  [3];  [4]
  1. Nanjing University of Science and Technology (China). Smart Computational Imaging (SCI) Laboratory and Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense
  2. Brookhaven National Lab. (BNL), Upton, NY (United States). National Synchrotron Light Source II (NSLS-II)
  3. Nanyang Technological University (Singapore). Centre for Optical and Laser Engineering (COLE), School of Mechanical and Aerospace Engineering
  4. Nanjing University of Science and Technology (China). Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense

We report that fringe projection profilometry is a well-established technique for optical 3D shape measurement. However, in many applications, it is desirable to make 3D measurements at very high speed, especially with fast moving or shape changing objects. In this work, we demonstrate a new 3D dynamic imaging technique, Micro Fourier Transform Profilometry (μFTP), which can realize an acquisition rate up to 10,000 3D frame per second (fps). The high measurement speed is achieved by the number of patterns reduction as well as high-speed fringe projection hardware. In order to capture 3D information in such a short period of time, we focus on the improvement of the phase recovery, phase unwrapping, and error compensation algorithms, allowing to reconstruct an accurate, unambiguous, and distortion-free 3D point cloud with every two projected patterns. We also develop a high-frame-rate fringe projection hardware by pairing a high-speed camera and a DLP projector, enabling binary pattern switching and precisely synchronized image capture at a frame rate up to 20,000 fps. Lastly, based on this system, we demonstrate high-quality textured 3D imaging of 4 transient scenes: vibrating cantilevers, rotating fan blades, flying bullet, and bursting balloon, which were previously difficult or even unable to be captured with conventional approaches.

Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
Grant/Contract Number:
SC0012704
OSTI ID:
1426465
Report Number(s):
BNL-203359-2018-JAAM
Journal Information:
Optics and Lasers in Engineering, Vol. 102, Issue C; ISSN 0143-8166
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 158 works
Citation information provided by
Web of Science

References (82)

High-speed photography journal June 1981
High-speed photography journal September 1983
An introduction to high speed photography and photonics journal December 2009
CMOS Image Sensors for High Speed Applications journal January 2009
Localization of inner hair cell mechanotransducer channels using high-speed calcium imaging journal March 2009
Time-resolved imaging of purely valence-electron dynamics during a chemical reaction journal April 2011
Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena journal April 2009
Sequentially timed all-optical mapping photography (STAMP) journal August 2014
Slow art with a trillion frames per second camera conference January 2011
Single-shot compressed ultrafast photography at one hundred billion frames per second journal December 2014
Reliability of Landing 3D Motion Analysis: Implications for Longitudinal Analyses journal January 2007
A survey on industrial vision systems, applications and tools journal February 2003
Assessment of High Speed Imaging Systems for 2D and 3D Deformation Measurements: Methodology Development and Validation journal January 2007
Vehicle crash accident reconstruction based on the analysis 3D deformation of the auto-body journal June 2008
Tomographic phase microscopy journal August 2007
Confocal optical microscopy journal March 1996
Super-resolution 3D microscopy of live whole cells using structured illumination journal October 2011
Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy journal May 2014
Mapping the world in 3D journal July 2010
Fringe projection techniques: Whither we are? journal February 2010
A state of the art in structured light patterns for surface profilometry journal August 2010
Structured-light 3D surface imaging: a tutorial journal January 2011
Dynamic 3-D shape measurement method: A review journal February 2010
Recent progresses on real-time 3D shape measurement using digital fringe projection techniques journal February 2010
Real-time structured light profilometry: a review journal December 2016
Flexible 3-D shape measurement using projector defocusing journal January 2009
Optimized pulse width modulation pattern strategy for three-dimensional profilometry with projector defocusing journal January 2012
Three-dimensional shape measurement with binary dithered patterns journal January 2012
Pattern codification strategies in structured light systems journal April 2004
Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques journal August 2012
Fourier transform profilometry: journal May 2001
Two-dimensional Fourier transform profilometry for the automatic measurement of three-dimensional object shapes journal November 1995
Improved Fourier transform profilometry for the automatic measurement of 3D object shapes journal January 1990
The effect of windowing in Fourier transform profilometry applied to noisy images journal June 2004
Fourier transform profilometry (FTP) using an innovative band-pass filter for accurate 3-D surface reconstruction journal February 2010
High-speed 3-D shape measurement based on digital fringe projection journal January 2003
Multiresolution three-dimensional measurement system with multiple cameras and light sectioning method journal December 2010
Automated phase-measuring profilometry of 3-D diffuse objects journal January 1984
Real-time three-dimensional shape measurement of moving objects without edge errors by time-synchronized structured illumination journal January 2010
Automatic identification and removal of outliers for high-speed fringe projection profilometry journal January 2013
Motion-induced error reduction by combining Fourier transform profilometry with phase-shifting profilometry journal January 2016
Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors journal January 1999
Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review journal October 2016
Superfast multifrequency phase-shifting technique with optimal pulse width modulation journal January 2011
Dual-frequency pattern scheme for high-speed 3-D shape measurement journal January 2010
High-speed three-dimensional profilometry for multiple objects with complex shapes journal January 2012
Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination journal November 2011
Unambiguous 3D measurement from speckle-embedded fringe journal January 2013
Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system journal January 2016
High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection journal August 2013
High-precision real-time 3D shape measurement using a bi-frequency scheme and multi-view system journal January 2017
Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects journal January 2013
High-speed three-dimensional measurements with a fringe projection-based optical sensor journal June 2014
Pixel-wise absolute phase unwrapping using geometric constraints of structured light system journal January 2016
Statistical patterns: an approach for high-speed and high-accuracy shape measurements journal April 2014
High-speed three-dimensional shape measurements of objects with laser speckles and acousto-optical deflection journal January 2011
Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement journal May 2014
High-speed three-dimensional shape measurement using GOBO projection journal December 2016
Motion-oriented high speed 3-D measurements by binocular fringe projection using binary aperiodic patterns journal January 2017
Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement journal January 2015
Real-time, high-accuracy 3D imaging and shape measurement journal November 2014
Fast data acquisition for three-dimensional shape measurement using fixed-pattern projection and temporal coding journal October 2011
Emerging digital micromirror device (DMD) applications conference January 2003
Fast two-dimensional phase-unwrapping algorithm based on sorting by reliability following a noncontinuous path journal January 2002
Reliability-guided phase unwrapping algorithm: a review journal September 2004
Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies journal January 2011
Optical 3-D shape and deformation measurement of rotating blades using stroboscopic structured illumination journal November 2005
Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. SHORT COMMUNICATION journal May 2000
DMD-based LED-illumination Super-resolution and optical sectioning microscopy journal January 2013
3D Computational Imaging with Single-Pixel Detectors journal May 2013
Automatic processing of fringe patterns in integer interferometers journal January 1991
Efficient multiple phase shift patterns for dense 3D acquisition in structured light scanning journal August 2010
Temporal phase unwrapping using orthographic projection journal March 2017
Two-wavelength phase shifting interferometry journal January 1984
Step height measurement using two-wavelength phase-shifting interferometry journal January 1987
Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency Selection journal January 2006
Geometric camera calibration using circular control points journal January 2000
Camera calibration with active phase target: improvement on feature detection and optimization journal January 2013
Robust Structured Light Coding for 3D Reconstruction conference January 2007
Lock-in Time-of-Flight (ToF) Cameras: A Survey journal September 2011
Fourier transform profilometry for the automatic measurement of 3-D object shapes journal January 1983
Simultaneous whole-animal 3D-imaging of neuronal activity using light field microscopy text January 2014

Cited By (21)

Dynamic 3D measurement of thermal deformation based on geometric-constrained stereo-matching with a stereo microscopic system journal September 2019
Optimal wavelength selection strategy in temporal phase unwrapping with projection distance minimization journal January 2018
Temporal phase unwrapping using deep learning journal December 2019
Single-shot absolute 3D shape measurement with deep-learning-based color fringe projection profilometry journal January 2020
Calibration method for panoramic 3D shape measurement with plane mirrors journal January 2019
High dynamic range 3D measurements with fringe projection profilometry: a review journal November 2018
Real-time motion-induced-error compensation in 3D surface-shape measurement journal January 2019
Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning journal January 2020
A simple and practical jump error removal method for fringe projection profilometry based on self-alignment technique journal December 2018
Key concepts for phase-to-coordinate conversion in fringe projection systems journal January 2019
High-speed real-time 3D shape measurement based on adaptive depth constraint journal January 2018
High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light journal January 2019
Real-time 3D shape measurement using 3LCD projection and deep machine learning journal January 2019
Motion-artifact-free dynamic 3D shape measurement with hybrid Fourier-transform phase-shifting profilometry journal January 2019
High-speed stereo-digital image correlation using a single color high-speed camera journal January 2018
High-speed three-dimensional shape measurement based on shifting Gray-code light journal January 2019
Dynamic microscopic 3D shape measurement based on marker-embedded Fourier transform profilometry journal January 2018
High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system journal January 2019
Temporal phase unwrapping using deep learning preprint January 2019
Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning text January 2019
3D Measurement of Human Chest and Abdomen Surface Based on 3D Fourier Transform and Time Phase Unwrapping journal February 2020

Figures / Tables (11)


Similar Records

High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping
Journal Article · Fri Nov 23 00:00:00 EST 2018 · Optics and Lasers in Engineering · OSTI ID:1426465

High-speed real-time 3D shape measurement based on adaptive depth constraint
Journal Article · Thu Aug 16 00:00:00 EDT 2018 · Optics Express · OSTI ID:1426465

Improved Fourier-transform profilometry
Journal Article · Sat Feb 10 00:00:00 EST 2007 · Applied Optics · OSTI ID:1426465