DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep-learning optical flow for measuring velocity fields from experimental data

Journal Article · · Soft Matter
DOI: https://doi.org/10.1039/D4SM00483C · OSTI ID:2439304
ORCiD logo [1];  [2];  [3]; ORCiD logo [4];  [2]; ORCiD logo [1]; ORCiD logo [5]; ORCiD logo [4]; ORCiD logo [1]
  1. Department of Physics, Brandeis University, Waltham, MA 02453, USA
  2. Department of Physics, University of California at Santa Barbara, Santa Barbara, CA 93106, USA
  3. Department of Physics, Brandeis University, Waltham, MA 02453, USA, Department of Physics, University of California at Santa Barbara, Santa Barbara, CA 93106, USA
  4. Department of Computer Science, Brandeis University, Waltham, MA 02453, USA
  5. Department of Physics, Brandeis University, Waltham, MA 02453, USA, Department of Physics, University of California at Santa Barbara, Santa Barbara, CA 93106, USA, Biomolecular and Engineering Science, University of California at Santa Barbara, Santa Barbara, CA 93106, USA

Deep learning-based optical flow (DLOF) extracts features in video frames with deep convolutional neural networks to estimate the inter-frame motions of objects. DLOF computes velocity fields more accurately than PIV for densely labeled systems.

Research Organization:
Brandeis University, Waltham, MA (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE
Grant/Contract Number:
SC0022291
OSTI ID:
2439304
Journal Information:
Soft Matter, Journal Name: Soft Matter Journal Issue: 36 Vol. 20; ISSN SMOABF; ISSN 1744-683X
Publisher:
Royal Society of Chemistry (RSC)Copyright Statement
Country of Publication:
United Kingdom
Language:
English

References (55)

Two-Frame Motion Estimation Based on Polynomial Expansion book January 2003
Assembling Microtubule-Based Active Matter book January 2022
Particle Image Velocimetry: A Practical Guide book January 2018
Performance of optical flow techniques journal February 1994
On the resolution limit of digital particle image velocimetry journal February 2012
Dense motion estimation of particle images via a convolutional neural network journal March 2019
Determining optical flow using a differential method journal January 1997
Measuring the velocity fields of granular flows – Employment of a multi-pass two-dimensional particle image velocimetry (2D-PIV) approach journal December 2018
Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition journal January 2016
Deep learning for fluid velocity field estimation: A review journal March 2023
Particle image velocimetry - Classical operating rules from today’s perspective journal December 2020
Data-Driven Science and Engineering book January 2022
Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods journal February 2005
Spontaneous motion in hierarchically assembled active matter journal November 2012
Topological chaos in active nematics journal August 2019
Machine learning for active matter journal February 2020
Deep recurrent optical flow learning for particle image velocimetry data journal July 2021
Dancing disclinations in confined active nematics journal January 2017
Machine learning forecasting of active nematics journal January 2021
Self-organized dynamics and the transition to turbulence of confined active nematics journal February 2019
Machine learning active-nematic hydrodynamics journal March 2021
Banding, excitability and chaos in active nematic suspensions journal July 2012
Random error due to Brownian motion in microscopic particle image velocimetry journal May 2007
Deep learning for physical processes: incorporating prior scientific knowledge journal December 2019
An integrated platform to facilitate the calculation, validation and visualization of optical flow velocities in biological images journal June 2021
Active nematic materials with substrate friction journal December 2014
Probing the shear viscosity of an active nematic film journal December 2016
Excitable Patterns in Active Nematics journal May 2011
Turbulent Dynamics of Epithelial Cell Cultures journal May 2018
Data-Driven Discovery of Active Nematic Hydrodynamics journal December 2022
Controlling Chaos: Periodic Defect Braiding in Active Nematics Confined to a Cardioid journal May 2024
Hydrodynamic Fluctuations and Instabilities in Ordered Suspensions of Self-Propelled Particles journal July 2002
Hydrodynamics of soft active matter journal July 2013
Evaluation of differential optical flow techniques on synthesized echo images journal March 1996
Dense estimation of fluid flows journal March 2002
ScopeFlow: Dynamic Scene Scoping for Optical Flow conference June 2020
SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warping conference June 2021
Learning Optical Flow from a Few Matches conference June 2021
Deep Equilibrium Optical Flow Estimation conference June 2022
DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labeling conference June 2023
FlowNet: Learning Optical Flow with Convolutional Networks conference December 2015
Learning to Estimate Hidden Motions with Global Motion Aggregation conference October 2021
Variational optical flow computation in real time journal May 2005
A Lightweight Optical Flow CNN —Revisiting Data Fidelity and Regularization journal August 2021
Tunable structure and dynamics of active liquid crystals journal October 2018
Elastic turbulence generates anomalous flow resistance in porous media journal November 2021
Physically informed data-driven modeling of active nematics journal July 2023
Long-Lived Giant Number Fluctuations in a Swarming Granular Nematic journal July 2007
The computation of optical flow journal September 1995
Vision meets robotics: The KITTI dataset journal August 2013
Differential techniques for optical flow journal May 1990
Video Action Recognition Using spatio-temporal optical flow video frames preprint January 2021
Particle Image Velocimetry for MATLAB: Accuracy and enhanced algorithms in PIVlab journal February 2021
Global morphogenetic flow is accurately predicted by the spatial distribution of myosin motors journal February 2018
Visceral organ morphogenesis via calcium-patterned muscle constrictions journal May 2022