An Efficient Parallel-in-Time Method for Optimization with Parabolic PDEs
Abstract
To solve optimization problems with parabolic PDE constraints, often methods working on the reduced objective functional are used. They are computationally expensive due to the necessity of solving both the state equation and a backward-in-time adjoint equation to evaluate the reduced gradient in each iteration of the optimization method. In this study, we investigate the use of the parallel-in-time method PFASST in the setting of PDE-constrained optimization. In order to develop an efficient fully time-parallel algorithm, we discuss different options for applying PFASST to adjoint gradient computation, including the possibility of doing PFASST iterations on both the state and the adjoint equations simultaneously. Here, we also explore the additional gains in efficiency from reusing information from previous optimization iterations when solving each equation. Numerical results for both a linear and a nonlinear reaction-diffusion optimal control problem demonstrate the parallel speedup and efficiency of different approaches.
- Authors:
-
[1];
[2]
- Zuse Inst. Berlin, Berlin (Germany)
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); German Research Foundation (DFG); Alexander von Humboldt Foundation
- OSTI Identifier:
- 1580377
- Grant/Contract Number:
- AC02-05CH11231
- Resource Type:
- Accepted Manuscript
- Journal Name:
- SIAM Journal on Scientific Computing
- Additional Journal Information:
- Journal Volume: 41; Journal Issue: 6; Journal ID: ISSN 1064-8275
- Publisher:
- SIAM
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; PDE-constrained optimization; parallel-in-time methods; PFASST
Citation Formats
Götschel, Sebastian, and Minion, Michael L. An Efficient Parallel-in-Time Method for Optimization with Parabolic PDEs. United States: N. p., 2019.
Web. doi:10.1137/19m1239313.
Götschel, Sebastian, & Minion, Michael L. An Efficient Parallel-in-Time Method for Optimization with Parabolic PDEs. United States. https://doi.org/10.1137/19m1239313
Götschel, Sebastian, and Minion, Michael L. Thu .
"An Efficient Parallel-in-Time Method for Optimization with Parabolic PDEs". United States. https://doi.org/10.1137/19m1239313. https://www.osti.gov/servlets/purl/1580377.
@article{osti_1580377,
title = {An Efficient Parallel-in-Time Method for Optimization with Parabolic PDEs},
author = {Götschel, Sebastian and Minion, Michael L.},
abstractNote = {To solve optimization problems with parabolic PDE constraints, often methods working on the reduced objective functional are used. They are computationally expensive due to the necessity of solving both the state equation and a backward-in-time adjoint equation to evaluate the reduced gradient in each iteration of the optimization method. In this study, we investigate the use of the parallel-in-time method PFASST in the setting of PDE-constrained optimization. In order to develop an efficient fully time-parallel algorithm, we discuss different options for applying PFASST to adjoint gradient computation, including the possibility of doing PFASST iterations on both the state and the adjoint equations simultaneously. Here, we also explore the additional gains in efficiency from reusing information from previous optimization iterations when solving each equation. Numerical results for both a linear and a nonlinear reaction-diffusion optimal control problem demonstrate the parallel speedup and efficiency of different approaches.},
doi = {10.1137/19m1239313},
journal = {SIAM Journal on Scientific Computing},
number = 6,
volume = 41,
place = {United States},
year = {2019},
month = {12}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 8 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Domain decomposition in time for PDE-constrained optimization
journal, December 2015
- Barker, Andrew T.; Stoll, Martin
- Computer Physics Communications, Vol. 197
A multigrid perspective on the parallel full approximation scheme in space and time: A multigrid perspective on PFASST
journal, June 2017
- Bolten, Matthias; Moser, Dieter; Speck, Robert
- Numerical Linear Algebra with Applications, Vol. 24, Issue 6
High-order multi-implicit spectral deferred correction methods for problems of reactive flow
journal, August 2003
- Bourlioux, Anne; Layton, Anita T.; Minion, Michael L.
- Journal of Computational Physics, Vol. 189, Issue 2
On the optimal control of the Schlögl-model
journal, March 2013
- Buchholz, Rico; Engel, Harald; Kammann, Eileen
- Computational Optimization and Applications, Vol. 56, Issue 1
A Nonlinear Conjugate Gradient Method with a Strong Global Convergence Property
journal, January 1999
- Dai, Y. H.; Yuan, Y.
- SIAM Journal on Optimization, Vol. 10, Issue 1
Toward an efficient parallel in time method for partial differential equations
journal, January 2012
- Emmett, Matthew; Minion, Michael
- Communications in Applied Mathematics and Computational Science, Vol. 7, Issue 1
Efficient estimation of personalized biventricular mechanical function employing gradient-based optimization: Efficient estimation of personalized biventricular mechanical function
journal, April 2018
- Finsberg, Henrik; Xi, Ce; Tan, Ju Le
- International Journal for Numerical Methods in Biomedical Engineering, Vol. 34, Issue 7
Function minimization by conjugate gradients
journal, February 1964
- Fletcher, R.
- The Computer Journal, Vol. 7, Issue 2
PARAEXP: A Parallel Integrator for Linear Initial-Value Problems
journal, January 2013
- Gander, Martin J.; Güttel, Stefan
- SIAM Journal on Scientific Computing, Vol. 35, Issue 2
Lossy compression for PDE-constrained optimization: adaptive error control
journal, November 2014
- Götschel, Sebastian; Weiser, Martin
- Computational Optimization and Applications, Vol. 62, Issue 1
A non-intrusive parallel-in-time adjoint solver with the XBraid library
journal, June 2018
- Günther, Stefanie; Gauger, Nicolas R.; Schroder, Jacob B.
- Computing and Visualization in Science, Vol. 19, Issue 3-4
A non-intrusive parallel-in-time approach for simultaneous optimization with unsteady PDEs
journal, May 2018
- Günther, S.; Gauger, N. R.; Schroder, J. B.
- Optimization Methods and Software, Vol. 34, Issue 6
A rational deferred correction approach to parabolic optimal control problems
journal, October 2017
- Güttel, Stefan; Pearson, John W.
- IMA Journal of Numerical Analysis, Vol. 38, Issue 4
Stable architectures for deep neural networks
journal, December 2017
- Haber, Eldad; Ruthotto, Lars
- Inverse Problems, Vol. 34, Issue 1
A time-domain decomposition iterative method for the solution of distributed linear quadratic optimal control problems
journal, January 2005
- Heinkenschloss, Matthias
- Journal of Computational and Applied Mathematics, Vol. 173, Issue 1
Additive Runge–Kutta schemes for convection–diffusion–reaction equations
journal, January 2003
- Kennedy, Christopher A.; Carpenter, Mark H.
- Applied Numerical Mathematics, Vol. 44, Issue 1-2
Parallel-In-Time Magnus Integrators
journal, January 2019
- Krull, B. T.; Minion, M. L.
- SIAM Journal on Scientific Computing, Vol. 41, Issue 5
Analysis of Block Parareal Preconditioners for Parabolic Optimal Control Problems
journal, January 2010
- Mathew, Tarek P.; Sarkis, Marcus; Schaerer, Christian E.
- SIAM Journal on Scientific Computing, Vol. 32, Issue 3
A hybrid parareal spectral deferred corrections method
journal, January 2010
- Minion, Michael
- Communications in Applied Mathematics and Computational Science, Vol. 5, Issue 2
Semi-implicit spectral deferred correction methods for ordinary differential equations
journal, January 2003
- Minion, Michael L.
- Communications in Mathematical Sciences, Vol. 1, Issue 3
The conjugate gradient method in extremal problems
journal, January 1969
- Polyak, B. T.
- USSR Computational Mathematics and Mathematical Physics, Vol. 9, Issue 4
A multi-level spectral deferred correction method
journal, August 2014
- Speck, Robert; Ruprecht, Daniel; Emmett, Matthew
- BIT Numerical Mathematics, Vol. 55, Issue 3
Faster SDC convergence on non-equidistant grids by DIRK sweeps
journal, December 2014
- Weiser, Martin
- BIT Numerical Mathematics, Vol. 55, Issue 4