Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems
Abstract
Uncertainty quantification techniques such as the time-dependent generalized polynomial chaos (TD-gPC) use an adaptive orthogonal basis to better represent the stochastic part of the solution space (aka random function space) in time. However, because the random function space is constructed using tensor products, TD-gPC-based methods are known to suffer from the curse of dimensionality. Here, we introduce a new numerical method called the flow-driven spectral chaos (FSC) which overcomes this curse of dimensionality at the random-function-space level. The proposed method is not only computationally more efficient than existing TD-gPC-based methods but is also far more accurate. The FSC method uses the concept of enriched stochastic flow maps to track the evolution of a finite-dimensional random function space efficiently in time. To transfer the probability information from one random function space to another, two approaches are developed and studied herein. In the first approach, the probability information is transferred in the mean-square sense, whereas in the second approach the transfer is done exactly using a new theorem that was developed for this purpose. The FSC method can quantify uncertainties with high fidelity, especially for the long-time response of stochastic dynamical systems governed by ODEs of arbitrary order. Six representative numerical examples,more »
- Authors:
-
- Purdue Univ., West Lafayette, IN (United States). Lyles School of Civil Engineering
- Purdue Univ., West Lafayette, IN (United States). School of Mechanical Engineering. Dept. of Mathematics
- Publication Date:
- Research Org.:
- Purdue Univ., West Lafayette, IN (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF); US Army Research Office (ARO)
- OSTI Identifier:
- 1853725
- Alternate Identifier(s):
- OSTI ID: 1775925
- Grant/Contract Number:
- SC0021142; CNS-1136075; DMS-1555072; DMS-1736364; CMMI-1634832; CMMI-1560834; W911NF-15-1-0562
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 430; Journal Issue: C; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; computer science; physics; uncertainty quantification; long-time integration; stochastic flow map; (nonlinear) stochastic dynamical systems; flow-driven spectral chaos (FSC); TD-gPC
Citation Formats
Esquivel, Hugo, Prakash, Arun, and Lin, Guang. Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems. United States: N. p., 2021.
Web. doi:10.1016/j.jcp.2020.110044.
Esquivel, Hugo, Prakash, Arun, & Lin, Guang. Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems. United States. https://doi.org/10.1016/j.jcp.2020.110044
Esquivel, Hugo, Prakash, Arun, and Lin, Guang. Fri .
"Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems". United States. https://doi.org/10.1016/j.jcp.2020.110044. https://www.osti.gov/servlets/purl/1853725.
@article{osti_1853725,
title = {Flow-driven spectral chaos (FSC) method for simulating long-time dynamics of arbitrary-order non-linear stochastic dynamical systems},
author = {Esquivel, Hugo and Prakash, Arun and Lin, Guang},
abstractNote = {Uncertainty quantification techniques such as the time-dependent generalized polynomial chaos (TD-gPC) use an adaptive orthogonal basis to better represent the stochastic part of the solution space (aka random function space) in time. However, because the random function space is constructed using tensor products, TD-gPC-based methods are known to suffer from the curse of dimensionality. Here, we introduce a new numerical method called the flow-driven spectral chaos (FSC) which overcomes this curse of dimensionality at the random-function-space level. The proposed method is not only computationally more efficient than existing TD-gPC-based methods but is also far more accurate. The FSC method uses the concept of enriched stochastic flow maps to track the evolution of a finite-dimensional random function space efficiently in time. To transfer the probability information from one random function space to another, two approaches are developed and studied herein. In the first approach, the probability information is transferred in the mean-square sense, whereas in the second approach the transfer is done exactly using a new theorem that was developed for this purpose. The FSC method can quantify uncertainties with high fidelity, especially for the long-time response of stochastic dynamical systems governed by ODEs of arbitrary order. Six representative numerical examples, including a nonlinear problem (the Van-der-Pol oscillator), are presented to demonstrate the performance of the FSC method and corroborate the claims of its superior numerical properties. Finally, a parametric, high-dimensional stochastic problem is used to demonstrate that when the FSC method is used in conjunction with Monte Carlo integration, the curse of dimensionality can be overcome altogether.},
doi = {10.1016/j.jcp.2020.110044},
journal = {Journal of Computational Physics},
number = C,
volume = 430,
place = {United States},
year = {Fri Feb 19 00:00:00 EST 2021},
month = {Fri Feb 19 00:00:00 EST 2021}
}
Works referenced in this record:
A concept for data-driven uncertainty quantification and its application to carbon dioxide storage in geological formations
journal, November 2011
- Oladyshkin, S.; Class, H.; Helmig, R.
- Advances in Water Resources, Vol. 34, Issue 11
Response Variability Of Stochastic Finite Element Systems
journal, March 1988
- Shinozuka, M.; Deodatis, G.
- Journal of Engineering Mechanics, Vol. 114, Issue 3
A convergence study for SPDEs using combined Polynomial Chaos and Dynamically-Orthogonal schemes
journal, July 2013
- Choi, Minseok; Sapsis, Themistoklis P.; Karniadakis, George Em
- Journal of Computational Physics, Vol. 245
The multi-element probabilistic collocation method (ME-PCM): Error analysis and applications
journal, November 2008
- Foo, Jasmine; Wan, Xiaoliang; Karniadakis, George Em
- Journal of Computational Physics, Vol. 227, Issue 22
Orthogonal functionals of the Poisson process
journal, July 1972
- Ogura, H.
- IEEE Transactions on Information Theory, Vol. 18, Issue 4
Long-time uncertainty propagation using generalized polynomial chaos and flow map composition
journal, October 2014
- Luchtenburg, Dirk M.; Brunton, Steven L.; Rowley, Clarence W.
- Journal of Computational Physics, Vol. 274
Uncertainty propagation in CFD using polynomial chaos decomposition
journal, September 2006
- Knio, O. M.; Le Maître, O. P.
- Fluid Dynamics Research, Vol. 38, Issue 9
The eigenvalue problem for structural systems with statistical properties.
journal, April 1969
- Collins, Jon D.; Thomson, WlLLIAM T.
- AIAA Journal, Vol. 7, Issue 4
Time-dependent generalized polynomial chaos
journal, November 2010
- Gerritsma, Marc; van der Steen, Jan-Bart; Vos, Peter
- Journal of Computational Physics, Vol. 229, Issue 22
Random field finite elements
journal, October 1986
- Liu, Wing Kam; Belytschko, Ted; Mani, A.
- International Journal for Numerical Methods in Engineering, Vol. 23, Issue 10
A Hybrid Generalized Polynomial Chaos Method for Stochastic Dynamical Systems
journal, January 2014
- Heuveline, Vincent; Schick, Michael
- International Journal for Uncertainty Quantification, Vol. 4, Issue 1
Stochastic Finite Elements with Multiple Random Non-Gaussian Properties
journal, January 1999
- Ghanem, Roger
- Journal of Engineering Mechanics, Vol. 125, Issue 1
A stochastic Galerkin expansion for nonlinear random vibration analysis
journal, January 1993
- Ghanem, R.; Spanos, P. D.
- Probabilistic Engineering Mechanics, Vol. 8, Issue 3-4
Nonlinear system modeling based on the Wiener theory
journal, January 1981
- Schetzen, M.
- Proceedings of the IEEE, Vol. 69, Issue 12
Minimal multi-element stochastic collocation for uncertainty quantification of discontinuous functions
journal, June 2013
- Jakeman, John D.; Narayan, Akil; Xiu, Dongbin
- Journal of Computational Physics, Vol. 242
Probabilistic finite elements for nonlinear structural dynamics
journal, May 1986
- Liu, Wing Kam; Belytschko, Ted; Mani, A.
- Computer Methods in Applied Mechanics and Engineering, Vol. 56, Issue 1
A Stochastic Projection Method for Fluid Flow
journal, November 2001
- Le Maı̂ tre, Olivier P.; Knio, Omar M.; Najm, Habib N.
- Journal of Computational Physics, Vol. 173, Issue 2
Multi-Element Generalized Polynomial Chaos for Arbitrary Probability Measures
journal, January 2006
- Wan, Xiaoliang; Karniadakis, George Em
- SIAM Journal on Scientific Computing, Vol. 28, Issue 3
Weighted Integral Method. II: Response Variability and Reliability
journal, August 1991
- Deodatis, George; Shinozuka, Masanobu
- Journal of Engineering Mechanics, Vol. 117, Issue 8
A polynomial chaos approach to the analysis of vehicle dynamics under uncertainty
journal, May 2012
- Kewlani, Gaurav; Crawford, Justin; Iagnemma, Karl
- Vehicle System Dynamics, Vol. 50, Issue 5
A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations I: Derivation and algorithms
journal, June 2013
- Cheng, Mulin; Hou, Thomas Y.; Zhang, Zhiwen
- Journal of Computational Physics, Vol. 242
Dynamical Polynomial Chaos Expansions and Long Time Evolution of Differential Equations with Random Forcing
journal, January 2016
- Ozen, H. Cagan; Bal, Guillaume
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 4, Issue 1
The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals
journal, April 1947
- Cameron, R. H.; Martin, W. T.
- The Annals of Mathematics, Vol. 48, Issue 2
Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics
journal, January 2009
- Najm, Habib N.
- Annual Review of Fluid Mechanics, Vol. 41, Issue 1
Long-term behavior of polynomial chaos in stochastic flow simulations
journal, August 2006
- Wan, Xiaoliang; Karniadakis, George Em
- Computer Methods in Applied Mechanics and Engineering, Vol. 195, Issue 41-43
Using stochastic analysis to capture unstable equilibrium in natural convection
journal, September 2005
- Asokan, Badrinarayanan Velamur; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 208, Issue 1
An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009
- Ma, Xiang; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 228, Issue 8
Beyond Wiener–Askey Expansions: Handling Arbitrary PDFs
journal, December 2005
- Wan, Xiaoliang; Karniadakis, George Em
- Journal of Scientific Computing, Vol. 27, Issue 1-3
High dimensional integration of smooth functions over cubes
journal, November 1996
- Novak, Erich; Ritter, Klaus
- Numerische Mathematik, Vol. 75, Issue 1
Uncertainty quantification in simulations of power systems: Multi-element polynomial chaos methods
journal, June 2010
- Prempraneerach, P.; Hover, F. S.; Triantafyllou, M. S.
- Reliability Engineering & System Safety, Vol. 95, Issue 6
Multi-element probabilistic collocation method in high dimensions
journal, March 2010
- Foo, Jasmine; Karniadakis, George Em
- Journal of Computational Physics, Vol. 229, Issue 5
A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2015
- Teckentrup, A. L.; Jantsch, P.; Webster, C. G.
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
Orthogonal functionals of independent-increment processes
journal, May 1976
- Segall, A.; Kailath, T.
- IEEE Transactions on Information Theory, Vol. 22, Issue 3
A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2008
- Nobile, F.; Tempone, R.; Webster, C. G.
- SIAM Journal on Numerical Analysis, Vol. 46, Issue 5
The Homogeneous Chaos
journal, October 1938
- Wiener, Norbert
- American Journal of Mathematics, Vol. 60, Issue 4
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
journal, January 2002
- Xiu, Dongbin; Karniadakis, George Em
- SIAM Journal on Scientific Computing, Vol. 24, Issue 2
A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations II: Adaptivity and generalizations
journal, June 2013
- Cheng, Mulin; Hou, Thomas Y.; Zhang, Zhiwen
- Journal of Computational Physics, Vol. 242
Multiple Wiener Integral
journal, May 1951
- Ito, Kiyosi
- Journal of the Mathematical Society of Japan, Vol. 3, Issue 1
A Stochastic Projection Method for Fluid Flow
journal, September 2002
- Le Maı̂tre, Olivier P.; Reagan, Matthew T.; Najm, Habib N.
- Journal of Computational Physics, Vol. 181, Issue 1
Polynomial Chaos in Stochastic Finite Elements
journal, March 1990
- Ghanem, Roger; Spanos, P. D.
- Journal of Applied Mechanics, Vol. 57, Issue 1
Weighted Integral Method. I: Stochastic Stiffness Matrix
journal, August 1991
- Deodatis, George
- Journal of Engineering Mechanics, Vol. 117, Issue 8
Dynamically orthogonal field equations for continuous stochastic dynamical systems
journal, December 2009
- Sapsis, Themistoklis P.; Lermusiaux, Pierre F. J.
- Physica D: Nonlinear Phenomena, Vol. 238, Issue 23-24
Error Analysis of the Dynamically Orthogonal Approximation of Time Dependent Random PDEs
journal, January 2015
- Musharbash, E.; Nobile, F.; Zhou, T.
- SIAM Journal on Scientific Computing, Vol. 37, Issue 2
An adaptive multi-element generalized polynomial chaos method for stochastic differential equations
journal, November 2005
- Wan, Xiaoliang; Karniadakis, George Em
- Journal of Computational Physics, Vol. 209, Issue 2
The Discrete Chaos
journal, April 1943
- Wiener, Norbert; Wintner, Aurel
- American Journal of Mathematics, Vol. 65, Issue 2
A domain adaptive stochastic collocation approach for analysis of MEMS under uncertainties
journal, November 2009
- Agarwal, Nitin; Aluru, N. R.
- Journal of Computational Physics, Vol. 228, Issue 20
A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
journal, January 2007
- Babuška, Ivo; Nobile, Fabio; Tempone, Raúl
- SIAM Journal on Numerical Analysis, Vol. 45, Issue 3
Numerical schemes for dynamically orthogonal equations of stochastic fluid and ocean flows
journal, January 2013
- Ueckermann, M. P.; Lermusiaux, P. F. J.; Sapsis, T. P.
- Journal of Computational Physics, Vol. 233
Neumann Expansion for Stochastic Finite Element Analysis
journal, August 1988
- Yamazaki, Fumio; Member, Associate; Shinozuka, Masanobu
- Journal of Engineering Mechanics, Vol. 114, Issue 8
The multi-element probabilistic collocation method (ME-PCM): Error analysis and applications
journal, November 2008
- Foo, Jasmine; Wan, Xiaoliang; Karniadakis, George Em
- Journal of Computational Physics, Vol. 227, Issue 22
Multi-element probabilistic collocation method in high dimensions
journal, March 2010
- Foo, Jasmine; Karniadakis, George Em
- Journal of Computational Physics, Vol. 229, Issue 5