DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems

Abstract

Uncertainty quantification techniques such as the time-dependent generalized polynomial chaos (TD-gPC) use an adaptive orthogonal basis to better represent the stochastic part of the solution space (aka random function space) in time. However, because the random function space is constructed using tensor products, TD-gPC-based methods are known to suffer from the curse of dimensionality. Here, we introduce a new numerical method called the flow-driven spectral chaos (FSC) which overcomes this curse of dimensionality at the random-function-space level. The proposed method is not only computationally more efficient than existing TD-gPC-based methods but is also far more accurate. The FSC method uses the concept of enriched stochastic flow maps to track the evolution of a finite-dimensional random function space efficiently in time. To transfer the probability information from one random function space to another, two approaches are developed and studied herein. In the first approach, the probability information is transferred in the mean-square sense, whereas in the second approach the transfer is done exactly using a new theorem that was developed for this purpose. The FSC method can quantify uncertainties with high fidelity, especially for the long-time response of stochastic dynamical systems governed by ODEs of arbitrary order. Six representative numerical examples,more » including a nonlinear problem (the Van-der-Pol oscillator), are presented to demonstrate the performance of the FSC method and corroborate the claims of its superior numerical properties. Finally, a parametric, high-dimensional stochastic problem is used to demonstrate that when the FSC method is used in conjunction with Monte Carlo integration, the curse of dimensionality can be overcome altogether.« less

Authors:
ORCiD logo [1];  [1]; ORCiD logo [2]
  1. Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
  2. Purdue Univ., West Lafayette, IN (United States). School of Mechanical Engineering. Dept. of Mathematics
Publication Date:
Research Org.:
Purdue Univ., West Lafayette, IN (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF); US Army Research Office (ARO)
OSTI Identifier:
1853725
Alternate Identifier(s):
OSTI ID: 1775925
Grant/Contract Number:  
SC0021142; CNS-1136075; DMS-1555072; DMS-1736364; CMMI-1634832; CMMI-1560834; W911NF-15-1-0562
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 430; Journal Issue: C; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; computer science; physics; uncertainty quantification; long-time integration; stochastic flow map; (nonlinear) stochastic dynamical systems; flow-driven spectral chaos (FSC); TD-gPC

Citation Formats

Esquivel, Hugo, Prakash, Arun, and Lin, Guang. Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems. United States: N. p., 2021. Web. doi:10.1016/j.jcp.2020.110044.
Esquivel, Hugo, Prakash, Arun, & Lin, Guang. Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems. United States. https://doi.org/10.1016/j.jcp.2020.110044
Esquivel, Hugo, Prakash, Arun, and Lin, Guang. Fri . "Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems". United States. https://doi.org/10.1016/j.jcp.2020.110044. https://www.osti.gov/servlets/purl/1853725.
@article{osti_1853725,
title = {Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems},
author = {Esquivel, Hugo and Prakash, Arun and Lin, Guang},
abstractNote = {Uncertainty quantification techniques such as the time-dependent generalized polynomial chaos (TD-gPC) use an adaptive orthogonal basis to better represent the stochastic part of the solution space (aka random function space) in time. However, because the random function space is constructed using tensor products, TD-gPC-based methods are known to suffer from the curse of dimensionality. Here, we introduce a new numerical method called the flow-driven spectral chaos (FSC) which overcomes this curse of dimensionality at the random-function-space level. The proposed method is not only computationally more efficient than existing TD-gPC-based methods but is also far more accurate. The FSC method uses the concept of enriched stochastic flow maps to track the evolution of a finite-dimensional random function space efficiently in time. To transfer the probability information from one random function space to another, two approaches are developed and studied herein. In the first approach, the probability information is transferred in the mean-square sense, whereas in the second approach the transfer is done exactly using a new theorem that was developed for this purpose. The FSC method can quantify uncertainties with high fidelity, especially for the long-time response of stochastic dynamical systems governed by ODEs of arbitrary order. Six representative numerical examples, including a nonlinear problem (the Van-der-Pol oscillator), are presented to demonstrate the performance of the FSC method and corroborate the claims of its superior numerical properties. Finally, a parametric, high-dimensional stochastic problem is used to demonstrate that when the FSC method is used in conjunction with Monte Carlo integration, the curse of dimensionality can be overcome altogether.},
doi = {10.1016/j.jcp.2020.110044},
journal = {Journal of Computational Physics},
number = C,
volume = 430,
place = {United States},
year = {Fri Feb 19 00:00:00 EST 2021},
month = {Fri Feb 19 00:00:00 EST 2021}
}

Works referenced in this record:

A concept for data-driven uncertainty quantification and its application to carbon dioxide storage in geological formations
journal, November 2011


Response Variability Of Stochastic Finite Element Systems
journal, March 1988


A convergence study for SPDEs using combined Polynomial Chaos and Dynamically-Orthogonal schemes
journal, July 2013

  • Choi, Minseok; Sapsis, Themistoklis P.; Karniadakis, George Em
  • Journal of Computational Physics, Vol. 245
  • DOI: 10.1016/j.jcp.2013.02.047

The multi-element probabilistic collocation method (ME-PCM): Error analysis and applications
journal, November 2008

  • Foo, Jasmine; Wan, Xiaoliang; Karniadakis, George Em
  • Journal of Computational Physics, Vol. 227, Issue 22
  • DOI: 10.1016/j.jcp.2008.07.009

Orthogonal functionals of the Poisson process
journal, July 1972


Long-time uncertainty propagation using generalized polynomial chaos and flow map composition
journal, October 2014

  • Luchtenburg, Dirk M.; Brunton, Steven L.; Rowley, Clarence W.
  • Journal of Computational Physics, Vol. 274
  • DOI: 10.1016/j.jcp.2014.06.029

Uncertainty propagation in CFD using polynomial chaos decomposition
journal, September 2006


The eigenvalue problem for structural systems with statistical properties.
journal, April 1969

  • Collins, Jon D.; Thomson, WlLLIAM T.
  • AIAA Journal, Vol. 7, Issue 4
  • DOI: 10.2514/3.5180

Time-dependent generalized polynomial chaos
journal, November 2010

  • Gerritsma, Marc; van der Steen, Jan-Bart; Vos, Peter
  • Journal of Computational Physics, Vol. 229, Issue 22
  • DOI: 10.1016/j.jcp.2010.07.020

Random field finite elements
journal, October 1986

  • Liu, Wing Kam; Belytschko, Ted; Mani, A.
  • International Journal for Numerical Methods in Engineering, Vol. 23, Issue 10
  • DOI: 10.1002/nme.1620231004

A Hybrid Generalized Polynomial Chaos Method for Stochastic Dynamical Systems
journal, January 2014


Stochastic Finite Elements with Multiple Random Non-Gaussian Properties
journal, January 1999


A stochastic Galerkin expansion for nonlinear random vibration analysis
journal, January 1993


Nonlinear system modeling based on the Wiener theory
journal, January 1981


Minimal multi-element stochastic collocation for uncertainty quantification of discontinuous functions
journal, June 2013


Probabilistic finite elements for nonlinear structural dynamics
journal, May 1986

  • Liu, Wing Kam; Belytschko, Ted; Mani, A.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 56, Issue 1
  • DOI: 10.1016/0045-7825(86)90136-2

A Stochastic Projection Method for Fluid Flow
journal, November 2001

  • Le Maı̂ tre, Olivier P.; Knio, Omar M.; Najm, Habib N.
  • Journal of Computational Physics, Vol. 173, Issue 2
  • DOI: 10.1006/jcph.2001.6889

Multi-Element Generalized Polynomial Chaos for Arbitrary Probability Measures
journal, January 2006

  • Wan, Xiaoliang; Karniadakis, George Em
  • SIAM Journal on Scientific Computing, Vol. 28, Issue 3
  • DOI: 10.1137/050627630

Weighted Integral Method. II: Response Variability and Reliability
journal, August 1991


A polynomial chaos approach to the analysis of vehicle dynamics under uncertainty
journal, May 2012


A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations I: Derivation and algorithms
journal, June 2013


Dynamical Polynomial Chaos Expansions and Long Time Evolution of Differential Equations with Random Forcing
journal, January 2016

  • Ozen, H. Cagan; Bal, Guillaume
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 4, Issue 1
  • DOI: 10.1137/15M1019167

The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals
journal, April 1947

  • Cameron, R. H.; Martin, W. T.
  • The Annals of Mathematics, Vol. 48, Issue 2
  • DOI: 10.2307/1969178

Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics
journal, January 2009


Long-term behavior of polynomial chaos in stochastic flow simulations
journal, August 2006

  • Wan, Xiaoliang; Karniadakis, George Em
  • Computer Methods in Applied Mechanics and Engineering, Vol. 195, Issue 41-43
  • DOI: 10.1016/j.cma.2005.10.016

Using stochastic analysis to capture unstable equilibrium in natural convection
journal, September 2005

  • Asokan, Badrinarayanan Velamur; Zabaras, Nicholas
  • Journal of Computational Physics, Vol. 208, Issue 1
  • DOI: 10.1016/j.jcp.2005.02.007

An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009


Beyond Wiener–Askey Expansions: Handling Arbitrary PDFs
journal, December 2005


High dimensional integration of smooth functions over cubes
journal, November 1996


Uncertainty quantification in simulations of power systems: Multi-element polynomial chaos methods
journal, June 2010

  • Prempraneerach, P.; Hover, F. S.; Triantafyllou, M. S.
  • Reliability Engineering & System Safety, Vol. 95, Issue 6
  • DOI: 10.1016/j.ress.2010.01.012

Multi-element probabilistic collocation method in high dimensions
journal, March 2010


A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2015

  • Teckentrup, A. L.; Jantsch, P.; Webster, C. G.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
  • DOI: 10.1137/140969002

Orthogonal functionals of independent-increment processes
journal, May 1976


A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2008

  • Nobile, F.; Tempone, R.; Webster, C. G.
  • SIAM Journal on Numerical Analysis, Vol. 46, Issue 5
  • DOI: 10.1137/060663660

The Homogeneous Chaos
journal, October 1938

  • Wiener, Norbert
  • American Journal of Mathematics, Vol. 60, Issue 4
  • DOI: 10.2307/2371268

The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
journal, January 2002


A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations II: Adaptivity and generalizations
journal, June 2013


Multiple Wiener Integral
journal, May 1951


A Stochastic Projection Method for Fluid Flow
journal, September 2002

  • Le Maı̂tre, Olivier P.; Reagan, Matthew T.; Najm, Habib N.
  • Journal of Computational Physics, Vol. 181, Issue 1
  • DOI: 10.1006/jcph.2002.7104

Polynomial Chaos in Stochastic Finite Elements
journal, March 1990

  • Ghanem, Roger; Spanos, P. D.
  • Journal of Applied Mechanics, Vol. 57, Issue 1
  • DOI: 10.1115/1.2888303

Weighted Integral Method. I: Stochastic Stiffness Matrix
journal, August 1991


Dynamically orthogonal field equations for continuous stochastic dynamical systems
journal, December 2009

  • Sapsis, Themistoklis P.; Lermusiaux, Pierre F. J.
  • Physica D: Nonlinear Phenomena, Vol. 238, Issue 23-24
  • DOI: 10.1016/j.physd.2009.09.017

Error Analysis of the Dynamically Orthogonal Approximation of Time Dependent Random PDEs
journal, January 2015

  • Musharbash, E.; Nobile, F.; Zhou, T.
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 2
  • DOI: 10.1137/140967787

An adaptive multi-element generalized polynomial chaos method for stochastic differential equations
journal, November 2005


The Discrete Chaos
journal, April 1943

  • Wiener, Norbert; Wintner, Aurel
  • American Journal of Mathematics, Vol. 65, Issue 2
  • DOI: 10.2307/2371816

A domain adaptive stochastic collocation approach for analysis of MEMS under uncertainties
journal, November 2009


A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
journal, January 2007

  • Babuška, Ivo; Nobile, Fabio; Tempone, Raúl
  • SIAM Journal on Numerical Analysis, Vol. 45, Issue 3
  • DOI: 10.1137/050645142

Numerical schemes for dynamically orthogonal equations of stochastic fluid and ocean flows
journal, January 2013

  • Ueckermann, M. P.; Lermusiaux, P. F. J.; Sapsis, T. P.
  • Journal of Computational Physics, Vol. 233
  • DOI: 10.1016/j.jcp.2012.08.041

Neumann Expansion for Stochastic Finite Element Analysis
journal, August 1988


The multi-element probabilistic collocation method (ME-PCM): Error analysis and applications
journal, November 2008

  • Foo, Jasmine; Wan, Xiaoliang; Karniadakis, George Em
  • Journal of Computational Physics, Vol. 227, Issue 22
  • DOI: 10.1016/j.jcp.2008.07.009

Multi-element probabilistic collocation method in high dimensions
journal, March 2010