A compute-bound formulation of Galerkin model reduction for linear time-invariant dynamical systems

Rizzi, Francesco; Parish, Eric J.; Blonigan, Patrick J.; Tencer, John

doi:10.1016/j.cma.2021.113973

A compute-bound formulation of Galerkin model reduction for linear time-invariant dynamical systems

Journal Article · Tue Jun 29 00:00:00 EDT 2021 · Computer Methods in Applied Mechanics and Engineering

DOI:https://doi.org/10.1016/j.cma.2021.113973· OSTI ID:1810771

^[1]; Parish, Eric J. ^[2]; Blonigan, Patrick J. ^[2]; ^[3]

NexGen Analytics, Sheridan, WY (United States)
Sandia National Lab. (SNL-CA), Livermore, CA (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

This work aims to advance computational methods for projection-based reduced-order models (ROMs) of linear time-invariant (LTI) dynamical systems. For such systems, current practice relies on ROM formulations expressing the state as a rank-1 tensor (i.e., a vector), leading to computational kernels that are memory bandwidth bound and, therefore, ill-suited for scalable performance on modern architectures. This weakness can be particularly limiting when tackling many-query studies, where one needs to run a large number of simulations. This work introduces a reformulation, called rank-2 Galerkin, of the Galerkin ROM for LTI dynamical systems which converts the nature of the ROM problem from memory bandwidth to compute bound. We present the details of the formulation and its implementation, and demonstrate its utility through numerical experiments using, as a test case, the simulation of elastic seismic shear waves in an axisymmetric domain. We quantify and analyze performance and scaling results for varying numbers of threads and problem sizes. In conclusion, we present an end-to-end demonstration of using the rank-2 Galerkin ROM for a Monte Carlo sampling study. We show that the rank-2 Galerkin ROM is one order of magnitude more efficient than the rank-1 Galerkin ROM (the current practice) and about 970 times more efficient than the full-order model, while maintaining accuracy in both the mean and statistics of the field.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States); NexGen Analytics, Sheridan, WY (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000; NA0003525

OSTI ID:: 1810771

Alternate ID(s):: OSTI ID: 1998972

Report Number(s):: SAND--2021-6660J; 696654

Journal Information:: Computer Methods in Applied Mechanics and Engineering, Journal Name: Computer Methods in Applied Mechanics and Engineering Vol. 384; ISSN 0045-7825

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (61)

Algorithms and analyses for stochastic optimization for turbofan noise reduction using parallel reduced-order modeling Yang, Huanhuan; Gunzburger, Max Computer Methods in Applied Mechanics and Engineering, Vol. 319 https://doi.org/10.1016/j.cma.2017.02.030	journal	June 2017
Real-time solution of linear computational problems using databases of parametric reduced-order models with arbitrary underlying meshes Amsallem, David; Tezaur, Radek; Farhat, Charbel Journal of Computational Physics, Vol. 326 https://doi.org/10.1016/j.jcp.2016.08.025	journal	December 2016
SH-wave propagation in the whole mantle using high-order finite differences Igel, Heiner; Weber, Michael Geophysical Research Letters, Vol. 22, Issue 6 https://doi.org/10.1029/95gl00312	journal	March 1995
SH-wave propagation in heterogeneous media: velocity-stress finite-difference method Virieux, J. Exploration Geophysics, Vol. 15, Issue 4 https://doi.org/10.1071/eg984265a	journal	December 1984
Generalized model of seismic pulse Rabinovich, E. V.; Filipenko, N. Y.; Shefel, G. S. Journal of Physics: Conference Series, Vol. 1015 https://doi.org/10.1088/1742-6596/1015/5/052025	journal	May 2018
Reduced-basis output bound methods for parabolic problems Rovas, D. V.; Machiels, L.; Maday, Y. IMA Journal of Numerical Analysis, Vol. 26, Issue 3 https://doi.org/10.1093/imanum/dri044	journal	July 2006
Performance Analysis and Optimization of Sparse Matrix-Vector Multiplication on Intel Xeon Phi Elafrou, Athena; Goumas, Georgios; Koziris, Nectarios 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/ipdpsw.2017.134	conference	May 2017
The optimal projection equations for model reduction and the relationships among the methods of Wilson, Skelton, and Moore Hyland, D.; Bernstein, D. IEEE Transactions on Automatic Control, Vol. 30, Issue 12 https://doi.org/10.1109/tac.1985.1103865	journal	December 1985
Synthesis of minimum roundoff noise fixed point digital filters Mullis, C.; Roberts, R. IEEE Transactions on Circuits and Systems, Vol. 23, Issue 9 https://doi.org/10.1109/tcs.1976.1084254	journal	September 1976
How to reconcile body-wave and normal-mode reference earth models Montagner, J. -P.; Kennett, B. L. N. Geophysical Journal International, Vol. 125, Issue 1 https://doi.org/10.1111/j.1365-246x.1996.tb06548.x	journal	April 1996
Reliable Real-Time Solution of Parametrized Partial Differential Equations: Reduced-Basis Output Bound Methods Prud’homme, C.; Rovas, D. V.; Veroy, K. Journal of Fluids Engineering, Vol. 124, Issue 1 https://doi.org/10.1115/1.1448332	journal	November 2001
Replicated Computational Results Certified BLIS: A Framework for Rapidly Instantiating BLAS Functionality Zee, Field G. VAN; Geijn, Robert A. VAN DE ACM Transactions on Mathematical Software, Vol. 41, Issue 3 https://doi.org/10.1145/2764454	journal	June 2015
Balanced model reduction via the proper orthogonal decomposition Willcox, K.; Peraire, J. 15th AIAA Computational Fluid Dynamics Conference https://doi.org/10.2514/6.2001-2611	conference	August 2001
Performance Modeling and Prediction for Dense Linear Algebra Peise, Elmar arXiv https://doi.org/10.48550/arxiv.1706.01341	preprint	January 2017
NVIDIA Tensor Core Programmability, Performance & Precision Markidis, Stefano; Der Chien, Steven Wei; Laure, Erwin arXiv https://doi.org/10.48550/arxiv.1803.04014	text	January 2018
Galerkin proper orthogonal decomposition methods for parabolic problems Kunisch, K.; Volkwein, S. Numerische Mathematik, Vol. 90, Issue 1 https://doi.org/10.1007/s002110100282	journal	November 2001
Model Order Reduction for Linear and Nonlinear Systems: A System-Theoretic Perspective Baur, Ulrike; Benner, Peter; Feng, Lihong Archives of Computational Methods in Engineering, Vol. 21, Issue 4 https://doi.org/10.1007/s11831-014-9111-2	journal	August 2014
Preliminary reference Earth model Dziewonski, Adam M.; Anderson, Don L. Physics of the Earth and Planetary Interiors, Vol. 25, Issue 4 https://doi.org/10.1016/0031-9201(81)90046-7	journal	June 1981
Analysis of microchannel heat sinks for electronics cooling Zhao, C. Y.; Lu, T. J. International Journal of Heat and Mass Transfer, Vol. 45, Issue 24 https://doi.org/10.1016/S0017-9310(02)00180-1	journal	November 2002
Structure-preserving model reduction for mechanical systems Lall, Sanjay; Krysl, Petr; Marsden, Jerrold E. Physica D: Nonlinear Phenomena, Vol. 184, Issue 1-4 https://doi.org/10.1016/S0167-2789(03)00227-6	journal	October 2003
Empirical model reduction of controlled nonlinear systems Lall, Sanjay; Marsden, Jerrold E.; Glavaški, Sonja IFAC Proceedings Volumes, Vol. 32, Issue 2 https://doi.org/10.1016/S1474-6670(17)56442-3	journal	July 1999
Frequency-domain characteristics of aerodynamic loads of offshore floating vertical axis wind turbines Borg, M.; Collu, M. Applied Energy, Vol. 155 https://doi.org/10.1016/j.apenergy.2015.06.038	journal	October 2015
Tensor based geology preserving reservoir parameterization with Higher Order Singular Value Decomposition (HOSVD) Afra, Sardar; Gildin, Eduardo Computers & Geosciences, Vol. 94 https://doi.org/10.1016/j.cageo.2016.05.010	journal	September 2016
Model order reduction with oblique projections for large scale wave propagation Pereyra, Victor Journal of Computational and Applied Mathematics, Vol. 295 https://doi.org/10.1016/j.cam.2015.01.029	journal	March 2016
Isogeometric fluid–structure interaction analysis with emphasis on non-matching discretizations, and with application to wind turbines Bazilevs, Y.; Hsu, M. -C.; Scott, M. A. Computer Methods in Applied Mechanics and Engineering, Vol. 249-252 https://doi.org/10.1016/j.cma.2012.03.028	journal	December 2012
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.07.003	journal	December 2014
Thermal management of urban subsurface resources - Delineation of boundary conditions Epting, Jannis Procedia Engineering, Vol. 209 https://doi.org/10.1016/j.proeng.2017.11.133	journal	January 2017
On the generation of sound by supersonic turbulent shear layers Phillips, O. M. Journal of Fluid Mechanics, Vol. 9, Issue 01 https://doi.org/10.1017/S0022112060000888	journal	September 1960
SH-wave propagation in the whole mantle using high-order finite differences Igel, Heiner; Weber, Michael Geophysical Research Letters, Vol. 22, Issue 6 https://doi.org/10.1029/95GL00312	journal	March 1995
Sensitivity of SS precursors to topography on the upper-mantle 660-km discontinuity Chaljub, Emmanuel; Tarantola, Albert Geophysical Research Letters, Vol. 24, Issue 21 https://doi.org/10.1029/97GL52693	journal	November 1997
Optimum solution of model-reduction problem Wilson, D. A. Proceedings of the Institution of Electrical Engineers, Vol. 117, Issue 6 https://doi.org/10.1049/piee.1970.0227	journal	January 1970
A posteriori error bounds for reduced-basis approximations of parametrized parabolic partial differential equations Grepl, Martin A.; Patera, Anthony T. ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 39, Issue 1 https://doi.org/10.1051/m2an:2005006	journal	January 2005
SH-wave propagation in heterogeneous media: velocity-stress finite-difference method Virieux, J. Exploration Geophysics, Vol. 15, Issue 4 https://doi.org/10.1071/EG984265a	journal	December 1984
A Survey of Model Reduction by Balanced Truncation and Some New Results Gugercin, Serkan; Antoulas, Athanasios C. International Journal of Control, Vol. 77, Issue 8 https://doi.org/10.1080/00207170410001713448	journal	May 2004
Thermomagnetic Convection in Square and Shallow Enclosures for Electronics Cooling Banerjee, Sumanta; Mukhopadhyay, Achintya; Sen, Swarnendu Numerical Heat Transfer, Part A: Applications, Vol. 55, Issue 10 https://doi.org/10.1080/10407780902925440	journal	May 2009
Structure preserving model order reduction of large sparse second-order index-1 systems and application to a mechatronics model Benner, Peter; Saak, Jens; Uddin, M. Monir Mathematical and Computer Modelling of Dynamical Systems, Vol. 22, Issue 6 https://doi.org/10.1080/13873954.2016.1218347	journal	August 2016
Turbulence and the dynamics of coherent structures. I. Coherent structures Sirovich, Lawrence Quarterly of Applied Mathematics, Vol. 45, Issue 3 https://doi.org/10.1090/qam/910462	journal	January 1987
Modelling two-dimensional global seismic wave propagation in a laterally heterogeneous whole-Moon model Wang, Yanbin; Takenaka, Hiroshi; Jiang, Xianghua Geophysical Journal International, Vol. 192, Issue 3 https://doi.org/10.1093/gji/ggs094	journal	December 2012
An efficient algorithm for simulating ensembles of parameterized flow problems Gunzburger, Max; Jiang, Nan; Wang, Zhu IMA Journal of Numerical Analysis, Vol. 39, Issue 3 https://doi.org/10.1093/imanum/dry029	journal	May 2018
Principal component analysis in linear systems: Controllability, observability, and model reduction Moore, B. IEEE Transactions on Automatic Control, Vol. 26, Issue 1 https://doi.org/10.1109/TAC.1981.1102568	journal	February 1981
The optimal projection equations for model reduction and the relationships among the methods of Wilson, Skelton, and Moore Hyland, D.; Bernstein, D. IEEE Transactions on Automatic Control, Vol. 30, Issue 12 https://doi.org/10.1109/TAC.1985.1103865	journal	December 1985
Synthesis of minimum roundoff noise fixed point digital filters Mullis, C.; Roberts, R. IEEE Transactions on Circuits and Systems, Vol. 23, Issue 9 https://doi.org/10.1109/TCS.1976.1084254	journal	September 1976
Current Injected Equivalent Circuit Approach to Modeling of Switching DC-DC Converters in Discontinuous Inductor Conduction Mode Chetty, P. R. K. IEEE Transactions on Industrial Electronics, Vol. IE-29, Issue 3 https://doi.org/10.1109/TIE.1982.356670	journal	January 1982
Constraints on seismic velocities in the Earth from traveltimes Kennett, B. L. N.; Engdahl, E. R.; Buland, R. Geophysical Journal International, Vol. 122, Issue 1 https://doi.org/10.1111/j.1365-246X.1995.tb03540.x	journal	July 1995
How to reconcile body-wave and normal-mode reference earth models Montagner, J. -P.; Kennett, B. L. N. Geophysical Journal International, Vol. 125, Issue 1 https://doi.org/10.1111/j.1365-246X.1996.tb06548.x	journal	April 1996
Global SH -wave propagation using a parallel axisymmetric spherical finite-difference scheme: application to whole mantle scattering Jahnke, Gunnar; Thorne, Michael S.; Cochard, Alain Geophysical Journal International, Vol. 173, Issue 3 https://doi.org/10.1111/j.1365-246X.2008.03744.x	journal	June 2008
Accelerated Solution of Discrete Ordinates Approximation to the Boltzmann Transport Equation for a Gray Absorbing–Emitting Medium Via Model Reduction Tencer, John; Carlberg, Kevin; Larsen, Marvin Journal of Heat Transfer, Vol. 139, Issue 12 https://doi.org/10.1115/1.4037098	journal	August 2017
$\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems Gugercin, S.; Antoulas, A. C.; Beattie, C. SIAM Journal on Matrix Analysis and Applications, Vol. 30, Issue 2 https://doi.org/10.1137/060666123	journal	January 2008
New POD Error Expressions, Error Bounds, and Asymptotic Results for Reduced Order Models of Parabolic PDEs Singler, John R. SIAM Journal on Numerical Analysis, Vol. 52, Issue 2 https://doi.org/10.1137/120886947	journal	January 2014
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems Benner, Peter; Gugercin, Serkan; Willcox, Karen SIAM Review, Vol. 57, Issue 4 https://doi.org/10.1137/130932715	journal	January 2015
An Ensemble-Proper Orthogonal Decomposition Method for the Nonstationary Navier--Stokes Equations Gunzburger, Max; Jiang, Nan; Schneier, Michael SIAM Journal on Numerical Analysis, Vol. 55, Issue 1 https://doi.org/10.1137/16M1056444	journal	January 2017
The BLIS Framework Van Zee, Field G.; Smith, Tyler M.; Marker, Bryan ACM Transactions on Mathematical Software, Vol. 42, Issue 2 https://doi.org/10.1145/2755561	journal	June 2016
Enabling Highly Efficient Batched Matrix Multiplications on SW26010 Many-core Processor Jiang, Lijuan; Yang, Chao; Ma, Wenjing ACM Transactions on Architecture and Code Optimization, Vol. 17, Issue 1 https://doi.org/10.1145/3378176	journal	March 2020
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows Berkooz, G.; Holmes, P.; Lumley, J. L. Annual Review of Fluid Mechanics, Vol. 25, Issue 1 https://doi.org/10.1146/annurev.fl.25.010193.002543	journal	January 1993
P-SV wave propagation in heterogeneous media: Velocity‐stress finite‐difference method Virieux, Jean GEOPHYSICS, Vol. 51, Issue 4 https://doi.org/10.1190/1.1442147	journal	April 1986
Nonlinear multiple scattering of acoustic waves by a layer of bubbles Lombard, O.; Barrière, C.; Leroy, V. EPL (Europhysics Letters), Vol. 112, Issue 2 https://doi.org/10.1209/0295-5075/112/24002	journal	October 2015
An Algorithm for fast Calculation of flow Ensembles Jiang, Nan; Layton, William International Journal for Uncertainty Quantification, Vol. 4, Issue 4 https://doi.org/10.1615/Int.J.UncertaintyQuantification.2014007691	journal	January 2014
Parametric Reduced-Order Models for Probabilistic Analysis of Unsteady Aerodynamic Applications Bui-Thanh, T.; Willcox, K.; Ghattas, O. AIAA Journal, Vol. 46, Issue 10 https://doi.org/10.2514/1.35850	journal	October 2008
Learning Physics-Based Reduced-Order Models for a Single-Injector Combustion Process Swischuk, Renee; Kramer, Boris; Huang, Cheng AIAA Journal, Vol. 58, Issue 6 https://doi.org/10.2514/1.J058943	journal	June 2020
Balanced Model Reduction via the Proper Orthogonal Decomposition Willcox, K.; Peraire, J. AIAA Journal, Vol. 40, Issue 11 https://doi.org/10.2514/2.1570	journal	November 2002
State-space representation of aerodynamic characteristics of an aircraft at high angles of attack Goman, M.; Khrabrov, A. Journal of Aircraft, Vol. 31, Issue 5 https://doi.org/10.2514/3.46618	journal	September 1994

Similar Records

The Adjoint Petrov–Galerkin method for non-linear model reduction

Journal Article · Thu Mar 19 00:00:00 EDT 2020 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1618094

Model reduction for hypersonic aerodynamics via conservative LSPG projection and hyper-reduction

Conference · Sat Jan 04 23:00:00 EST 2020 · AIAA Scitech Forum · OSTI ID:1619242

Preconditioned least‐squares Petrov–Galerkin reduced order models

Journal Article · Wed Jun 29 00:00:00 EDT 2022 · International Journal for Numerical Methods in Engineering · OSTI ID:1886405

Related Subjects

97 MATHEMATICS AND COMPUTING
BLAS
C++
GPU
Galerkin
HPC
Kokkos
Monte Carlo
POD
compute-bound
elastic shear waves
generic programming
linear time-invariant dynamical systems
many-core
memory bandwidth bound
projection-based model reduction
seismic modeling
uncertainty quantification

A compute-bound formulation of Galerkin model reduction for linear time-invariant dynamical systems

Citation Formats

References (61)

Similar Records

Related Subjects