Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling

Ahmed, Shady E.; San, Omer; Rasheed, Adil; Iliescu, Traian; Veneziani, Alessandro

doi:10.1137/22m1496360

Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling

Journal Article · 06 June 2023 · SIAM Journal on Scientific Computing

DOI:https://doi.org/10.1137/22m1496360· OSTI ID:2421108

^[1]; ^[2]; Rasheed, Adil ^[3]; Iliescu, Traian ^[4]; ^[5]

School of Mechanical & Aerospace Engineering, Oklahoma State University, Stillwater, OK 74078 USA.; OSTI
School of Mechanical & Aerospace Engineering, Oklahoma State University, Stillwater, OK 74078 USA.
Department of Engineering Cybernetics, Norwegian University of Science and Technology, N-7465, Trondheim, Norway.
Department of Mathematics, Virginia Tech, Blacksburg, VA 24061 USA.
Department of Mathematics, Department of Computer Science, Emory University, Atlanta, GA 30322 USA.

Not provided.

Research Organization:: Oklahoma State Univ., Stillwater, OK (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: SC0019290

OSTI ID:: 2421108

Journal Information:: SIAM Journal on Scientific Computing, Journal Name: SIAM Journal on Scientific Computing Journal Issue: 3 Vol. 45; ISSN 1064-8275

Publisher:: Society for Industrial and Applied Mathematics (SIAM)

Country of Publication:: United States

Language:: English

References (76)

Turbulence and the dynamics of coherent structures. III. Dynamics and scaling Sirovich, Lawrence Quarterly of Applied Mathematics, Vol. 45, Issue 3 https://doi.org/10.1090/qam/910464	journal	January 1987
Goal-oriented, model-constrained optimization for reduction of large-scale systems Bui-Thanh, T.; Willcox, K.; Ghattas, O. Journal of Computational Physics, Vol. 224, Issue 2 https://doi.org/10.1016/j.jcp.2006.10.026	journal	June 2007
Turbulence, Coherent Structures, Dynamical Systems and Symmetry Holmes, Philip; Lumley, John L.; Berkooz, Gahl Cambridge University Press https://doi.org/10.1017/CBO9780511919701	book	January 2012
Reduced order modeling of fluid flows: Machine learning, Kolmogorov barrier, closure modeling, and partitioning (Invited) Ahmed, Shady E.; Pawar, Suraj; San, Omer AIAA AVIATION 2020 FORUM https://doi.org/10.2514/6.2020-2946	conference	June 2020
A Reduced-Order Method for Simulation and Control of Fluid Flows Ito, K.; Ravindran, S. S. Journal of Computational Physics, Vol. 143, Issue 2 https://doi.org/10.1006/jcph.1998.5943	journal	July 1998
The variational multiscale method—a paradigm for computational mechanics Hughes, Thomas J. R.; Feijóo, Gonzalo R.; Mazzei, Luca Computer Methods in Applied Mechanics and Engineering, Vol. 166, Issue 1-2 https://doi.org/10.1016/S0045-7825(98)00079-6	journal	November 1998
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders Lee, Kookjin; Carlberg, Kevin T. Journal of Computational Physics https://doi.org/10.1016/j.jcp.2019.108973	journal	November 2019
PEBL-ROM: Projection-error based local reduced-order models Amsallem, David; Haasdonk, Bernard Advanced Modeling and Simulation in Engineering Sciences, Vol. 3, Issue 1 https://doi.org/10.1186/s40323-016-0059-7	journal	March 2016
Stochastic Tools in Mathematics and Science Chorin, Alexandre; Hald, Ole H. Surveys and Tutorials in the Applied Mathematical Sciences https://doi.org/10.1007/978-1-4419-1002-8	book	January 2009
Nonlinear proper orthogonal decomposition for convection-dominated flows Ahmed, Shady E.; San, Omer; Rasheed, Adil Physics of Fluids, Vol. 33, Issue 12 https://doi.org/10.1063/5.0074310	journal	December 2021
Progressive construction of a parametric reduced-order model for PDE-constrained optimization: PDE-CONSTRAINED OPTIMIZATION USING A PROGRESSIVELY CONSTRUCTED ROM Zahr, Matthew J.; Farhat, Charbel International Journal for Numerical Methods in Engineering, Vol. 102, Issue 5 https://doi.org/10.1002/nme.4770	journal	December 2014
Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization Peherstorfer, Benjamin; Willcox, Karen; Gunzburger, Max SIAM Review, Vol. 60, Issue 3 https://doi.org/10.1137/16M1082469	journal	January 2018
Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison Wang, Zhu; Akhtar, Imran; Borggaard, Jeff Computer Methods in Applied Mechanics and Engineering, Vol. 237-240 https://doi.org/10.1016/j.cma.2012.04.015	journal	September 2012
Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism Wang, Qian; Ripamonti, Nicolò; Hesthaven, Jan S. Journal of Computational Physics, Vol. 410 https://doi.org/10.1016/j.jcp.2020.109402	journal	June 2020
Deep Learning with Long Short-Term Memory for Time Series Prediction Hua, Yuxiu; Zhao, Zhifeng; Li, Rongpeng IEEE Communications Magazine, Vol. 57, Issue 6 https://doi.org/10.1109/MCOM.2019.1800155	journal	June 2019
POD-Galerkin approximations in PDE-constrained optimization Sachs, Ekkehard W.; Volkwein, Stefan GAMM-Mitteilungen, Vol. 33, Issue 2 https://doi.org/10.1002/gamm.201010015	journal	October 2010
Data-driven variational multiscale reduced order models Mou, Changhong; Koc, Birgul; San, Omer Computer Methods in Applied Mechanics and Engineering, Vol. 373 https://doi.org/10.1016/j.cma.2020.113470	journal	January 2021
Transport, Collective Motion, and Brownian Motion Mori, Hazime Progress of Theoretical Physics, Vol. 33, Issue 3 https://doi.org/10.1143/PTP.33.423	journal	March 1965
Data-driven POD-Galerkin reduced order model for turbulent flows Hijazi, Saddam; Stabile, Giovanni; Mola, Andrea Journal of Computational Physics, Vol. 416 https://doi.org/10.1016/j.jcp.2020.109513	journal	September 2020
Time-series machine-learning error models for approximate solutions to parameterized dynamical systems Parish, Eric J.; Carlberg, Kevin T. Computer Methods in Applied Mechanics and Engineering, Vol. 365 https://doi.org/10.1016/j.cma.2020.112990	journal	June 2020
Variational multiscale proper orthogonal decomposition: Convection-dominated convection-diffusion-reaction equations Iliescu, Traian; Wang, Zhu Mathematics of Computation, Vol. 82, Issue 283 https://doi.org/10.1090/S0025-5718-2013-02683-X	journal	March 2013
On closures for reduced order models—A spectrum of first-principle to machine-learned avenues Ahmed, Shady E.; Pawar, Suraj; San, Omer Physics of Fluids, Vol. 33, Issue 9 https://doi.org/10.1063/5.0061577	journal	September 2021
Breaking the Kolmogorov Barrier in Model Reduction of Fluid Flows Ahmed, Shady E.; San, Omer Fluids, Vol. 5, Issue 1 https://doi.org/10.3390/fluids5010026	journal	February 2020
Data-Driven Filtered Reduced Order Modeling of Fluid Flows Xie, X.; Mohebujjaman, M.; Rebholz, L. G. SIAM Journal on Scientific Computing, Vol. 40, Issue 3 https://doi.org/10.1137/17M1145136	journal	January 2018
Blending Modified Gaussian Closure and Non-Gaussian Reduced Subspace Methods for Turbulent Dynamical Systems Sapsis, Themistoklis P.; Majda, Andrew J. Journal of Nonlinear Science, Vol. 23, Issue 6 https://doi.org/10.1007/s00332-013-9178-1	journal	July 2013
Optimal prediction and the Mori-Zwanzig representation of irreversible processes Chorin, A. J.; Hald, O. H.; Kupferman, R. Proceedings of the National Academy of Sciences, Vol. 97, Issue 7 https://doi.org/10.1073/pnas.97.7.2968	journal	March 2000
A POD-Galerkin reduced order model for a LES filtering approach Girfoglio, Michele; Quaini, Annalisa; Rozza, Gianluigi Journal of Computational Physics, Vol. 436 https://doi.org/10.1016/j.jcp.2021.110260	journal	July 2021
Optimal prediction with memory Chorin, Alexandre J.; Hald, Ole H.; Kupferman, Raz Physica D: Nonlinear Phenomena, Vol. 166, Issue 3-4 https://doi.org/10.1016/S0167-2789(02)00446-3	journal	June 2002
Comparative numerical analysis using reduced-order modeling strategies for nonlinear large-scale systems Dimitriu, Gabriel; Ştefănescu, Răzvan; Navon, Ionel M. Journal of Computational and Applied Mathematics, Vol. 310 https://doi.org/10.1016/j.cam.2016.07.002	journal	January 2017
The ROMES Method for Statistical Modeling of Reduced-Order-Model Error Drohmann, Martin; Carlberg, Kevin SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1 https://doi.org/10.1137/140969841	journal	January 2015
Machine-learning error models for approximate solutions to parameterized systems of nonlinear equations Freno, Brian A.; Carlberg, Kevin T. Computer Methods in Applied Mechanics and Engineering, Vol. 348 https://doi.org/10.1016/j.cma.2019.01.024	journal	May 2019
Model Order Reduction a Key Technology for Digital Twins Hartmann, Dirk; Herz, Matthias; Wever, Utz Reduced-Order Modeling (ROM) for Simulation and Optimization https://doi.org/10.1007/978-3-319-75319-5_8	book	January 2018
Renormalized Mori–Zwanzig-reduced models for systems without scale separation Stinis, Panos Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 471, Issue 2176 https://doi.org/10.1098/rspa.2014.0446	journal	April 2015
Comparison of POD reduced order strategies for the nonlinear 2D shallow water equations: POD STRATEGIES FOR 2D SWE Ştefănescu, Răzvan; Sandu, Adrian; Navon, Ionel M. International Journal for Numerical Methods in Fluids, Vol. 76, Issue 8 https://doi.org/10.1002/fld.3946	journal	August 2014
Digital Twin in Industry: State-of-the-Art Tao, Fei; Zhang, He; Liu, Ang IEEE Transactions on Industrial Informatics, Vol. 15, Issue 4 https://doi.org/10.1109/TII.2018.2873186	journal	April 2019
A dynamic closure modeling framework for model order reduction of geophysical flows Rahman, Sk. M.; Ahmed, S. E.; San, O. Physics of Fluids, Vol. 31, Issue 4 https://doi.org/10.1063/1.5093355	journal	April 2019
Extreme learning machine for reduced order modeling of turbulent geophysical flows San, Omer; Maulik, Romit Physical Review E, Vol. 97, Issue 4 https://doi.org/10.1103/PhysRevE.97.042322	journal	April 2018
Modal Analysis of Fluid Flows: An Overview Taira, Kunihiko; Brunton, Steven L.; Dawson, Scott T. M. AIAA Journal, Vol. 55, Issue 12 https://doi.org/10.2514/1.J056060	journal	December 2017
Model Reduction for Flow Analysis and Control Rowley, Clarence W.; Dawson, Scott T. M. Annual Review of Fluid Mechanics, Vol. 49, Issue 1 https://doi.org/10.1146/annurev-fluid-010816-060042	journal	January 2017
In silico trials: Verification, validation and uncertainty quantification of predictive models used in the regulatory evaluation of biomedical products Viceconti, Marco; Pappalardo, Francesco; Rodriguez, Blanca Methods, Vol. 185 https://doi.org/10.1016/j.ymeth.2020.01.011	journal	January 2021
Nonlinear closure modeling in reduced order models for turbulent flows: a dynamical system approach Imtiaz, Haroon; Akhtar, Imran Nonlinear Dynamics, Vol. 99, Issue 1 https://doi.org/10.1007/s11071-019-05087-2	journal	July 2019
Model fusion with physics-guided machine learning: Projection-based reduced-order modeling Pawar, Suraj; San, Omer; Nair, Aditya Physics of Fluids, Vol. 33, Issue 6 https://doi.org/10.1063/5.0053349	journal	June 2021
The need for a pressure-term representation in empirical Galerkin models of incompressible shear flows Noack, Bernd R.; Papas, Paul; Monkewitz, Peter A. Journal of Fluid Mechanics, Vol. 523 https://doi.org/10.1017/S0022112004002149	journal	January 1999
Breaking the Kolmogorov Barrier with Nonlinear Model Reduction Peherstorfer, Benjamin Notices of the American Mathematical Society, Vol. 69, Issue 05 https://doi.org/10.1090/noti2475	journal	May 2022
Digital twin – Proof of concept Haag, Sebastian; Anderl, Reiner Manufacturing Letters, Vol. 15 https://doi.org/10.1016/j.mfglet.2018.02.006	journal	January 2018
Physics guided machine learning using simplified theories Pawar, Suraj; San, Omer; Aksoylu, Burak Physics of Fluids, Vol. 33, Issue 1 https://doi.org/10.1063/5.0038929	journal	January 2021
Turbulence and the dynamics of coherent structures. II. Symmetries and transformations Sirovich, Lawrence Quarterly of Applied Mathematics, Vol. 45, Issue 3 https://doi.org/10.1090/qam/910463	journal	January 1987
Neural closure models for dynamical systems Gupta, Abhinav; Lermusiaux, Pierre F. J. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 477, Issue 2252 https://doi.org/10.1098/rspa.2020.1004	journal	August 2021
Minimal subspace rotation on the Stiefel manifold for stabilization and enhancement of projection-based reduced order models for the compressible Navier–Stokes equations Balajewicz, Maciej; Tezaur, Irina; Dowell, Earl Journal of Computational Physics, Vol. 321 https://doi.org/10.1016/j.jcp.2016.05.037	journal	September 2016
Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction Carlberg, Kevin; Barone, Matthew; Antil, Harbir Journal of Computational Physics, Vol. 330 https://doi.org/10.1016/j.jcp.2016.10.033	journal	February 2017
Nonequilibrium Statistical Mechanics Zwanzig, Robert Oxford Scholarship Online https://doi.org/10.1093/oso/9780195140187.001.0001	book	April 2001
Verifiability of the Data-Driven Variational Multiscale Reduced Order Model Koc, Birgul; Mou, Changhong; Liu, Honghu Journal of Scientific Computing, Vol. 93, Issue 2 https://doi.org/10.1007/s10915-022-02019-y	journal	October 2022
Digital Twin: Values, Challenges and Enablers From a Modeling Perspective Rasheed, Adil; San, Omer; Kvamsdal, Trond IEEE Access, Vol. 8 https://doi.org/10.1109/ACCESS.2020.2970143	journal	January 2020
Projection-based model reduction: Formulations for physics-based machine learning Swischuk, Renee; Mainini, Laura; Peherstorfer, Benjamin Computers & Fluids, Vol. 179 https://doi.org/10.1016/j.compfluid.2018.07.021	journal	January 2019
Turbulence and the dynamics of coherent structures. I. Coherent structures Sirovich, Lawrence Quarterly of Applied Mathematics, Vol. 45, Issue 3 https://doi.org/10.1090/qam/910462	journal	January 1987
Efficient High-Resolution Wake Modeling Using the Vorticity Transport Equation Brown, Richard E.; Line, Andrew J. AIAA Journal, Vol. 43, Issue 7 https://doi.org/10.2514/1.13679	journal	July 2005
A long short-term memory embedding for hybrid uplifted reduced order models Ahmed, Shady E.; San, Omer; Rasheed, Adil Physica D: Nonlinear Phenomena, Vol. 409 https://doi.org/10.1016/j.physd.2020.132471	journal	August 2020
New POD Error Expressions, Error Bounds, and Asymptotic Results for Reduced Order Models of Parabolic PDEs Singler, John R. SIAM Journal on Numerical Analysis, Vol. 52, Issue 2 https://doi.org/10.1137/120886947	journal	January 2014
A probabilistic graphical model foundation for enabling predictive digital twins at scale Kapteyn, Michael G.; Pretorius, Jacob V. R.; Willcox, Karen E. Nature Computational Science, Vol. 1, Issue 5 https://doi.org/10.1038/s43588-021-00069-0	journal	May 2021
Data-Driven Discovery of Closure Models Pan, Shaowu; Duraisamy, Karthik SIAM Journal on Applied Dynamical Systems, Vol. 17, Issue 4 https://doi.org/10.1137/18M1177263	journal	January 2018
Design optimization using hyper-reduced-order models Amsallem, David; Zahr, Matthew; Choi, Youngsoo Structural and Multidisciplinary Optimization, Vol. 51, Issue 4 https://doi.org/10.1007/s00158-014-1183-y	journal	November 2014
Reduced-order modeling: new approaches for computational physics Lucia, David J.; Beran, Philip S.; Silva, Walter A. Progress in Aerospace Sciences, Vol. 40, Issue 1-2 https://doi.org/10.1016/j.paerosci.2003.12.001	journal	February 2004
Interpolation among reduced-order matrices to obtain parameterized models for design, optimization and probabilistic analysis Degroote, Joris; Vierendeels, Jan; Willcox, Karen International Journal for Numerical Methods in Fluids https://doi.org/10.1002/fld.2089	journal	January 2009
Stabilization of projection-based reduced order models of the Navier–Stokes Balajewicz, Maciej; Dowell, Earl H. Nonlinear Dynamics, Vol. 70, Issue 2 https://doi.org/10.1007/s11071-012-0561-5	journal	August 2012
A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation San, Omer; Iliescu, Traian Advances in Computational Mathematics, Vol. 41, Issue 5 https://doi.org/10.1007/s10444-015-9417-0	journal	May 2015
Reduced Order Model Based on Principal Component Analysis for Process Simulation and Optimization ^† Lang, Yi-dong; Malacina, Adam; Biegler, Lorenz T. Energy & Fuels, Vol. 23, Issue 3 https://doi.org/10.1021/ef800984v	journal	March 2009
Variational multiscale proper orthogonal decomposition: Navier-stokes equations: VARIATIONAL MULTISCALE POD Iliescu, Traian; Wang, Zhu Numerical Methods for Partial Differential Equations, Vol. 30, Issue 2 https://doi.org/10.1002/num.21835	journal	December 2013
Efficient estimation of cardiac conductivities via POD-DEIM model order reduction Yang, Huanhuan; Veneziani, Alessandro Applied Numerical Mathematics, Vol. 115 https://doi.org/10.1016/j.apnum.2017.01.006	journal	May 2017
On the stability and extension of reduced-order Galerkin models in incompressible flows: A numerical study of vortex shedding Akhtar, Imran; Nayfeh, Ali H.; Ribbens, Calvin J. Theoretical and Computational Fluid Dynamics, Vol. 23, Issue 3 https://doi.org/10.1007/s00162-009-0112-y	journal	June 2009
Large eddy simulation of turbulent channel flows by the variational multiscale method Hughes, Thomas J. R.; Oberai, Assad A.; Mazzei, Luca Physics of Fluids, Vol. 13, Issue 6 https://doi.org/10.1063/1.1367868	journal	June 2001
Modal Analysis of Fluid Flows: Applications and Outlook Taira, Kunihiko; Hemati, Maziar S.; Brunton, Steven L. AIAA Journal, Vol. 58, Issue 3 https://doi.org/10.2514/1.J058462	journal	March 2020
A model reduction approach for the variational estimation of vascular compliance by solving an inverse fluid–structure interaction problem Bertagna, Luca; Veneziani, Alessandro Inverse Problems, Vol. 30, Issue 5 https://doi.org/10.1088/0266-5611/30/5/055006	journal	April 2014
Large Eddy Simulation and the variational multiscale method Hughes, Thomas J. R.; Mazzei, Luca; Jansen, Kenneth E. Computing and Visualization in Science, Vol. 3, Issue 1-2 https://doi.org/10.1007/s007910050051	journal	May 2000
A coarse-grid projection method for accelerating incompressible flow computations San, Omer; Staples, Anne E. Journal of Computational Physics, Vol. 233 https://doi.org/10.1016/j.jcp.2012.09.005	journal	January 2013
A hierarchy of low-dimensional models for the transient and post-transient cylinder wake Noack, Bernd R.; Afanasiev, Konstantin; MorzyŃSki, Marek Journal of Fluid Mechanics, Vol. 497 https://doi.org/10.1017/S0022112003006694	journal	December 2003
Stability Properties of POD-Galerkin Approximations for the Compressible Navier-Stokes Equations Iollo, A.; Lanteri, S.; Désidéri, J. -A. Theoretical and Computational Fluid Dynamics, Vol. 13, Issue 6 https://doi.org/10.1007/s001620050119	journal	March 2000

Similar Records

Model fusion with physics-guided machine learning: Projection-based reduced-order modeling

Journal Article · 2021 · Physics of Fluids · OSTI ID:1853024

Data-driven variational multiscale reduced order models

Journal Article · 2020 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1853021

Related Subjects

Mathematics

Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling

Citation Formats

References (76)

Similar Records

Related Subjects