DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Anderson acceleration with approximate calculations: Applications to scientific computing

Journal Article · · Numerical Linear Algebra with Applications
DOI: https://doi.org/10.1002/nla.2562 · OSTI ID:2439013

Here we provide rigorous theoretical bounds for Anderson acceleration (AA) that allow for approximate calculations when applied to solve linear problems. We show that, when the approximate calculations satisfy the provided error bounds, the convergence of AA is maintained while the computational time could be reduced. We also provide computable heuristic quantities, guided by the theoretical error bounds, which can be used to automate the tuning of accuracy while performing approximate calculations. For linear problems, the use of heuristics to monitor the error introduced by approximate calculations, combined with the check on monotonicity of the residual, ensures the convergence of the numerical scheme within a prescribed residual tolerance. Motivated by the theoretical studies, we propose a reduced variant of AA, which consists in projecting the least-squares used to compute the Anderson mixing onto a subspace of reduced dimension. The dimensionality of this subspace adapts dynamically at each iteration as prescribed by the computable heuristic quantities. We numerically show and assess the performance of AA with approximate calculations on: (i) linear deterministic fixed-point iterations arising from the Richardson's scheme to solve linear systems with open-source benchmark matrices with various preconditioners and (ii) non-linear deterministic fixed-point iterations arising from non-linear time-dependent Boltzmann equations.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE; USDOE Office of Science (SC)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
2439013
Journal Information:
Numerical Linear Algebra with Applications, Journal Name: Numerical Linear Algebra with Applications Journal Issue: 5 Vol. 31; ISSN 1070-5325
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (30)

Convergence analysis of Anderson‐type acceleration of Richardson's iteration journal April 2019
Two classes of multisecant methods for nonlinear acceleration journal March 2009
Preconditioning Techniques for Large Linear Systems: A Survey journal November 2002
Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods: Part II journal December 1961
Numerical methods for solving linear least squares problems journal June 1965
Perturbation theory for pseudo-inverses journal June 1973
Benchmarking optimization software with performance profiles journal January 2002
Neutrino transport in core collapse supernovae journal September 1999
Alternating Anderson–Richardson method: An efficient alternative to preconditioned Krylov methods for large, sparse linear systems journal January 2019
Periodic Pulay method for robust and efficient convergence acceleration of self-consistent field iterations journal March 2016
Anderson acceleration of the Jacobi iterative method: An efficient alternative to Krylov methods for large, sparse linear systems journal February 2016
A fast implicit solver for semiconductor models in one space dimension journal September 2020
A characterization of the behavior of the Anderson acceleration on linear problems journal February 2013
Stellar core collapse - Numerical model and infall epoch journal August 1985
Anderson acceleration for contractive and noncontractive operators journal January 2021
Shanks and Anderson-type acceleration techniques for systems of nonlinear equations journal August 2021
Nonlinear Acceleration of Constrained Optimization Algorithms conference May 2019
Iterative Methods for Sparse Linear Systems book January 2003
Anderson Acceleration for Fixed-Point Iterations journal January 2011
Convergence Analysis for Anderson Acceleration journal January 2015
Local Improvement Results for Anderson Acceleration with Inaccurate Function Evaluations journal January 2017
LSMB: Minimizing the Backward Error for Least-Squares Problems journal January 2018
Globally Convergent Type-I Anderson Acceleration for Nonsmooth Fixed-Point Iterations journal January 2020
A Proof That Anderson Acceleration Improves the Convergence Rate in Linearly Converging Fixed-Point Methods (But Not in Those Converging Quadratically) journal January 2020
Anderson Accelerated Douglas--Rachford Splitting journal January 2020
Analysis of a New Implicit Solver for a Semiconductor Model journal January 2021
Theory of Inexact Krylov Subspace Methods and Applications to Scientific Computing journal January 2003
The university of Florida sparse matrix collection journal November 2011
Iterative Procedures for Nonlinear Integral Equations journal October 1965
Reducing the bandwidth of sparse symmetric matrices conference January 1969