DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO

Abstract

In this work, we provide a new approach for the efficient matrix-free application of the transpose of the Jacobian for the spectral element method for the adjoint-based solution of partial differential equation (PDE) constrained optimization. This results in optimizations of nonlinear PDEs using explicit integrators where the integration of the adjoint problem is not more expensive than the forward simulation. Solving PDE constrained optimization problems entails combining expertise from multiple areas, including simulation, computation of derivatives, and optimization. The Portable, Extensible Toolkit for Scientific computation (PETSc) together with its companion package, the Toolkit for Advanced Optimization (TAO), is an integrated numerical software library that contains an algorithmic/software stack for solving linear systems, nonlinear systems, ordinary differential equations, differential algebraic equations, and large-scale optimization problems and, as such, is an ideal tool for performing PDE-constrained optimization. This paper describes an efficient approach in which the software stack provided by PETSc/TAO can be used for large-scale nonlinear time-dependent problems. Time integration can involve a range of high-order methods, both implicit and explicit. The PDE-constrained optimization algorithm used is gradient-based and seamlessly integrated with the simulation of the physical problem.

Authors:
 [1];  [1];  [1]
  1. Argonne National Lab. (ANL), Lemont, IL (United States)
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
National Science Foundation (NSF); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1776612
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Science
Additional Journal Information:
Journal Volume: 47; Journal ID: ISSN 1877-7503
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; PDE-constrained optimization; PETSc; TAO; adjoint; spectral element method

Citation Formats

Marin, Oana, Constantinescu, Emil, and Smith, Barry. A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO. United States: N. p., 2020. Web. doi:10.1016/j.jocs.2020.101207.
Marin, Oana, Constantinescu, Emil, & Smith, Barry. A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO. United States. https://doi.org/10.1016/j.jocs.2020.101207
Marin, Oana, Constantinescu, Emil, and Smith, Barry. Fri . "A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO". United States. https://doi.org/10.1016/j.jocs.2020.101207. https://www.osti.gov/servlets/purl/1776612.
@article{osti_1776612,
title = {A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO},
author = {Marin, Oana and Constantinescu, Emil and Smith, Barry},
abstractNote = {In this work, we provide a new approach for the efficient matrix-free application of the transpose of the Jacobian for the spectral element method for the adjoint-based solution of partial differential equation (PDE) constrained optimization. This results in optimizations of nonlinear PDEs using explicit integrators where the integration of the adjoint problem is not more expensive than the forward simulation. Solving PDE constrained optimization problems entails combining expertise from multiple areas, including simulation, computation of derivatives, and optimization. The Portable, Extensible Toolkit for Scientific computation (PETSc) together with its companion package, the Toolkit for Advanced Optimization (TAO), is an integrated numerical software library that contains an algorithmic/software stack for solving linear systems, nonlinear systems, ordinary differential equations, differential algebraic equations, and large-scale optimization problems and, as such, is an ideal tool for performing PDE-constrained optimization. This paper describes an efficient approach in which the software stack provided by PETSc/TAO can be used for large-scale nonlinear time-dependent problems. Time integration can involve a range of high-order methods, both implicit and explicit. The PDE-constrained optimization algorithm used is gradient-based and seamlessly integrated with the simulation of the physical problem.},
doi = {10.1016/j.jocs.2020.101207},
journal = {Journal of Computational Science},
number = ,
volume = 47,
place = {United States},
year = {Fri Sep 11 00:00:00 EDT 2020},
month = {Fri Sep 11 00:00:00 EDT 2020}
}

Works referenced in this record:

FATODE: A Library for Forward, Adjoint, and Tangent Linear Integration of ODEs
journal, January 2014

  • Zhang, Hong; Sandu, Adrian
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 5
  • DOI: 10.1137/130912335

Spin up problem and accelerating convergence to steady state
journal, March 2013


On the limited memory BFGS method for large scale optimization
journal, August 1989

  • Liu, Dong C.; Nocedal, Jorge
  • Mathematical Programming, Vol. 45, Issue 1-3
  • DOI: 10.1007/BF01589116

Generalizing global error estimation for ordinary differential equations by using coupled time-stepping methods
journal, April 2018


Line search algorithms with guaranteed sufficient decrease
journal, September 1994

  • Moré, Jorge J.; Thuente, David J.
  • ACM Transactions on Mathematical Software, Vol. 20, Issue 3
  • DOI: 10.1145/192115.192132

On reducing computational effort in topology optimization: we can go at least this far!
journal, October 2018

  • Limkilde, Asger; Evgrafov, Anton; Gravesen, Jens
  • Structural and Multidisciplinary Optimization, Vol. 58, Issue 6
  • DOI: 10.1007/s00158-018-2121-1

Unsteady Adjoint Method for the Optimal Control of Advection and Burger's Equations Using High-Order Spectral Difference Method
conference, June 2012

  • Ou, Kui; Jameson, Antony
  • 49th AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition
  • DOI: 10.2514/6.2011-24

SuperLU_DIST: A scalable distributed-memory sparse direct solver for unsymmetric linear systems
journal, June 2003

  • Li, Xiaoye S.; Demmel, James W.
  • ACM Transactions on Mathematical Software, Vol. 29, Issue 2
  • DOI: 10.1145/779359.779361

JuMP: A Modeling Language for Mathematical Optimization
journal, January 2017

  • Dunning, Iain; Huchette, Joey; Lubin, Miles
  • SIAM Review, Vol. 59, Issue 2
  • DOI: 10.1137/15M1020575

On reducing computational effort in topology optimization: how far can we go?
journal, October 2010


Algorithm 799: revolve: an implementation of checkpointing for the reverse or adjoint mode of computational differentiation
journal, March 2000

  • Griewank, Andreas; Walther, Andrea
  • ACM Transactions on Mathematical Software, Vol. 26, Issue 1
  • DOI: 10.1145/347837.347846

Automated Derivation of the Adjoint of High-Level Transient Finite Element Programs
journal, January 2013

  • Farrell, P. E.; Ham, D. A.; Funke, S. W.
  • SIAM Journal on Scientific Computing, Vol. 35, Issue 4
  • DOI: 10.1137/120873558

Discretely Exact Derivatives for Hyperbolic PDE-Constrained Optimization Problems Discretized by the Discontinuous Galerkin Method
journal, August 2014

  • Wilcox, Lucas C.; Stadler, Georg; Bui-Thanh, Tan
  • Journal of Scientific Computing, Vol. 63, Issue 1
  • DOI: 10.1007/s10915-014-9890-5

Asynchronous Two-level Checkpointing Scheme for Large-scale Adjoints in the Spectral-Element Solver Nek5000
journal, January 2016


SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005

  • Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
  • ACM Transactions on Mathematical Software, Vol. 31, Issue 3
  • DOI: 10.1145/1089014.1089020