skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations

Abstract

Structures with complex geometries, material properties, and boundary conditions exhibit spatially local dynamic behaviors. A high-spatial-resolution model of the structure is thus required for high-fidelity analysis, assessment, and prediction of the dynamic phenomena of the structure. The traditional approach is to build a highly refined finite element computer model for simulating and analyzing the structural dynamic phenomena based on detailed knowledge and explicit modeling of the structural physics such as geometries, materials properties, and boundary conditions. These physics information of the structure may not be available or accurately modeled in many cases, however. In addition, the simulation on the high-spatial-resolution structural model, with a massive number of degrees of freedom and system parameters, is computationally demanding. Here this study, on a proof-of-principle basis, proposes a novel alternative approach for spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field structural dynamics by an innovative combination of the fundamentals of structural dynamic modeling and the advanced video motion manipulation techniques. Specifically, a low-modal-dimensional yet high-spatial (pixel)-resolution (as many spatial points as the pixel number on the structure in the video frame) modal model is established in the spatiotemporal video domain with full-field modal parameters first estimated from line-of-sight video measurements of themore » operating structure. Then in order to simulate new dynamic response of the structure subject to a new force, the force is projected onto each modal domain, and the modal response is computed by solving each individual single-degree-of-freedom system in the modal domain. The simulated modal responses are then synthesized by the full-field mode shapes using modal superposition to obtain the simulated full-field structural dynamic response. Finally, the simulated structural dynamic response is embedded into the original video, replacing the original motion of the video, thus generating a new photo-realistic, physically accurate video that enables a realistic, high-fidelity visualization/animation of the simulated full-field vibration of the structure. Laboratory experiments are conducted to validate the proposed method, and the error sources and limitations in practical implementations are also discussed. Compared with high-fidelity finite element computer model simulations of structural dynamics, the video-based simulation method removes the need to explicitly model the structure's physics. In addition, the photo-realistic, physically accurate simulated video provides a realistic visualization/animation of the full-field structural dynamic response, which was not traditionally available. Lastly, these features of the proposed method should enable a new alternative to the traditional computer-aided finite element model simulation for high-fidelity simulating and realistically visualizing full-field structural dynamics in a relatively efficient and user-friendly manner.« less

Authors:
ORCiD logo [1];  [2];  [3];  [4]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  2. California Inst. of Technology (CalTech), Pasadena, CA (United States). Dept. of Aerospace Engineering
  3. Univ. of Texas, Austin, TX (United States). Dept. of Aerospace Engineering and Engineering Mechanics
  4. Missouri Univ. of Science and Technology, Rolla, MO (United States). Dept. of Mechanical and Aerospace Engineering
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE Laboratory Directed Research and Development (LDRD) Program
OSTI Identifier:
1458934
Report Number(s):
LA-UR-16-21726
Journal ID: ISSN 1545-2255
Grant/Contract Number:  
AC52-06NA25396
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Structural Control and Health Monitoring
Additional Journal Information:
Journal Volume: 25; Journal Issue: 8; Journal ID: ISSN 1545-2255
Publisher:
Wiley
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; full-field vibration measurement; high-fidelity simulation; modal analysis; motion synthesis; structural dynamics; video processing; visualization

Citation Formats

Yang, Yongchao, Dorn, Charles, Mancini, Tyler, Talken, Zachary, Kenyon, Garrett, Farrar, Charles Reed, and Mascarenas, David Dennis Lee. Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations. United States: N. p., 2018. Web. doi:10.1002/stc.2193.
Yang, Yongchao, Dorn, Charles, Mancini, Tyler, Talken, Zachary, Kenyon, Garrett, Farrar, Charles Reed, & Mascarenas, David Dennis Lee. Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations. United States. doi:10.1002/stc.2193.
Yang, Yongchao, Dorn, Charles, Mancini, Tyler, Talken, Zachary, Kenyon, Garrett, Farrar, Charles Reed, and Mascarenas, David Dennis Lee. Fri . "Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations". United States. doi:10.1002/stc.2193. https://www.osti.gov/servlets/purl/1458934.
@article{osti_1458934,
title = {Spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field dynamic responses of structures by a combination of high-spatial-resolution modal model and video motion manipulations},
author = {Yang, Yongchao and Dorn, Charles and Mancini, Tyler and Talken, Zachary and Kenyon, Garrett and Farrar, Charles Reed and Mascarenas, David Dennis Lee},
abstractNote = {Structures with complex geometries, material properties, and boundary conditions exhibit spatially local dynamic behaviors. A high-spatial-resolution model of the structure is thus required for high-fidelity analysis, assessment, and prediction of the dynamic phenomena of the structure. The traditional approach is to build a highly refined finite element computer model for simulating and analyzing the structural dynamic phenomena based on detailed knowledge and explicit modeling of the structural physics such as geometries, materials properties, and boundary conditions. These physics information of the structure may not be available or accurately modeled in many cases, however. In addition, the simulation on the high-spatial-resolution structural model, with a massive number of degrees of freedom and system parameters, is computationally demanding. Here this study, on a proof-of-principle basis, proposes a novel alternative approach for spatiotemporal video-domain high-fidelity simulation and realistic visualization of full-field structural dynamics by an innovative combination of the fundamentals of structural dynamic modeling and the advanced video motion manipulation techniques. Specifically, a low-modal-dimensional yet high-spatial (pixel)-resolution (as many spatial points as the pixel number on the structure in the video frame) modal model is established in the spatiotemporal video domain with full-field modal parameters first estimated from line-of-sight video measurements of the operating structure. Then in order to simulate new dynamic response of the structure subject to a new force, the force is projected onto each modal domain, and the modal response is computed by solving each individual single-degree-of-freedom system in the modal domain. The simulated modal responses are then synthesized by the full-field mode shapes using modal superposition to obtain the simulated full-field structural dynamic response. Finally, the simulated structural dynamic response is embedded into the original video, replacing the original motion of the video, thus generating a new photo-realistic, physically accurate video that enables a realistic, high-fidelity visualization/animation of the simulated full-field vibration of the structure. Laboratory experiments are conducted to validate the proposed method, and the error sources and limitations in practical implementations are also discussed. Compared with high-fidelity finite element computer model simulations of structural dynamics, the video-based simulation method removes the need to explicitly model the structure's physics. In addition, the photo-realistic, physically accurate simulated video provides a realistic visualization/animation of the full-field structural dynamic response, which was not traditionally available. Lastly, these features of the proposed method should enable a new alternative to the traditional computer-aided finite element model simulation for high-fidelity simulating and realistically visualizing full-field structural dynamics in a relatively efficient and user-friendly manner.},
doi = {10.1002/stc.2193},
journal = {Structural Control and Health Monitoring},
issn = {1545-2255},
number = 8,
volume = 25,
place = {United States},
year = {2018},
month = {6}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 2 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A vision-based approach for the direct measurement of displacements in vibrating systems
journal, September 2003

  • Wahbeh, A. Mazen; Caffrey, John P.; Masri, Sami F.
  • Smart Materials and Structures, Vol. 12, Issue 5
  • DOI: 10.1088/0964-1726/12/5/016

Physical interpretation of independent component analysis in structural dynamics
journal, May 2007

  • Kerschen, G.; Poncelet, F.; Golinval, J. -C.
  • Mechanical Systems and Signal Processing, Vol. 21, Issue 4
  • DOI: 10.1016/j.ymssp.2006.07.009

Determining optical flow
journal, August 1981


Interactive motion generation from examples
journal, July 2002


Phase-based video motion processing
journal, July 2013

  • Wadhwa, Neal; Rubinstein, Michael; Durand, Frédo
  • ACM Transactions on Graphics, Vol. 32, Issue 4
  • DOI: 10.1145/2461912.2461966

A phase-based approach to the estimation of the optical flow field using spatial filtering
journal, September 2002


Frequency response functions of shape features from full-field vibration measurements using digital image correlation
journal, April 2012

  • Wang, Weizhuo; Mottershead, John E.; Siebert, Thorsten
  • Mechanical Systems and Signal Processing, Vol. 28
  • DOI: 10.1016/j.ymssp.2011.11.023

3D digital image correlation methods for full-field vibration measurement
journal, April 2011

  • Helfrick, Mark N.; Niezrecki, Christopher; Avitabile, Peter
  • Mechanical Systems and Signal Processing, Vol. 25, Issue 3
  • DOI: 10.1016/j.ymssp.2010.08.013

A study and extension of second-order blind source separation to operational modal analysis
journal, February 2013


Finite element model updating from full-field vibration measurement using digital image correlation
journal, April 2011

  • Wang, Weizhuo; Mottershead, John E.; Ihle, Alexander
  • Journal of Sound and Vibration, Vol. 330, Issue 8
  • DOI: 10.1016/j.jsv.2010.10.036

Image-space modal bases for plausible manipulation of objects in video
journal, October 2015

  • Davis, Abe; Chen, Justin G.; Durand, Frédo
  • ACM Transactions on Graphics, Vol. 34, Issue 6
  • DOI: 10.1145/2816795.2818095

A framework for blind modal identification using joint approximate diagonalization
journal, October 2008


On the Physical Interpretation of Proper Orthogonal Modes in Vibrations
journal, April 1998


Modal Testing Using a Scanning Laser Doppler Vibrometer
journal, March 1999

  • Stanbridge, A. B.; Ewins, D. J.
  • Mechanical Systems and Signal Processing, Vol. 13, Issue 2
  • DOI: 10.1006/mssp.1998.1209

Extracting full-field dynamic strain on a wind turbine rotor subjected to arbitrary excitations using 3D point tracking and a modal expansion technique
journal, September 2015

  • Baqersad, Javad; Niezrecki, Christopher; Avitabile, Peter
  • Journal of Sound and Vibration, Vol. 352
  • DOI: 10.1016/j.jsv.2015.04.026

Response-only modal identification of structures using strong motion data: RESPONSE-ONLY MODAL IDENTIFICATION OF STRUCTURES USING STRONG MOTION DATA
journal, November 2012

  • Ghahari, S. F.; Abazarsa, F.; Ghannad, M. A.
  • Earthquake Engineering & Structural Dynamics, Vol. 42, Issue 8
  • DOI: 10.1002/eqe.2268

Blind modal identification of output-only structures in time-domain based on complexity pursuit: BLIND IDENTIFICATION OF MODAL PARAMETERS BASED ON COMPLEXITY PURSUIT
journal, May 2013

  • Yang, Yongchao; Nagarajaiah, Satish
  • Earthquake Engineering & Structural Dynamics, Vol. 42, Issue 13
  • DOI: 10.1002/eqe.2302

Computation of component image velocity from local phase information
journal, August 1990

  • Fleet, David J.; Jepson, Allan D.
  • International Journal of Computer Vision, Vol. 5, Issue 1
  • DOI: 10.1007/BF00056772

Flexible Videogrammetric Technique for Three-Dimensional Structural Vibration Measurement
journal, June 2007


On the application of blind source separation for damping estimation of bridges under traffic loading
journal, December 2014


Cost-effective vision-based system for monitoring dynamic response of civil engineering structures
journal, November 2010

  • Fukuda, Yoshio; Feng, Maria Q.; Shinozuka, Masanobu
  • Structural Control and Health Monitoring, Vol. 17, Issue 8
  • DOI: 10.1002/stc.360

The subpixel resolution of optical-flow-based modal analysis
journal, May 2017


Blind separation of vibration components: Principles and demonstrations
journal, November 2005


Modal identification of simple structures with high-speed video using motion magnification
journal, June 2015


Decentralized modal identification of structures using parallel factor decomposition and sparse blind source separation
journal, December 2013


Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification
journal, February 2017


Target-free approach for vision-based structural system identification using consumer-grade cameras: Target-Free Vision-based Structural System Identification
journal, February 2016

  • Yoon, Hyungchul; Elanwar, Hazem; Choi, Hajin
  • Structural Control and Health Monitoring, Vol. 23, Issue 12
  • DOI: 10.1002/stc.1850

A Database and Evaluation Methodology for Optical Flow
journal, November 2010

  • Baker, Simon; Scharstein, Daniel; Lewis, J. P.
  • International Journal of Computer Vision, Vol. 92, Issue 1
  • DOI: 10.1007/s11263-010-0390-2