DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multistart algorithm for identifying all optima of nonconvex stochastic functions

Journal Article · · Optimization Letters
ORCiD logo [1];  [2]
  1. Texas A & M Univ., College Station, TX (United States)
  2. Argonne National Laboratory (ANL), Argonne, IL (United States)

Here, we propose a multistart algorithm to identify all local minima of a constrained, nonconvex stochastic optimization problem. The algorithm uniformly samples points in the domain and then starts a local stochastic optimization run from any point that is the "probabilistically best" point in its neighborhood. Under certain conditions, our algorithm is shown to asymptotically identify all local optima with high probability; this holds even though our algorithm is shown to almost surely start only finitely many local stochastic optimization runs. We demonstrate the performance of an implementation of our algorithm on nonconvex stochastic optimization problems, including identifying optimal variational parameters for the quantum approximate optimization algorithm.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
2476909
Journal Information:
Optimization Letters, Journal Name: Optimization Letters Journal Issue: 6 Vol. 18; ISSN 1862-4472
Publisher:
Springer NatureCopyright Statement
Country of Publication:
United States
Language:
English

References (30)

Amyloid Polymorphism in the Protein Folding and Aggregation Energy Landscape journal June 2018
Stochastic global optimization methods part I: Clustering methods journal September 1987
Stochastic global optimization methods part II: Multi level methods journal September 1987
Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization journal December 2014
Accelerated gradient methods for nonconvex nonlinear and stochastic programming journal February 2015
A genetic algorithm for a global optimization problem arising in the detection of gravitational waves journal January 2010
A quasi-multistart framework for global optimization of expensive functions using response surface models journal June 2012
Multistart with early termination of descents journal July 2019
Stochastic optimization with adaptive restart: a framework for integrated local and global learning journal July 2020
Asynchronously parallel optimization solver for finding multiple minima journal February 2018
Calculating all local minima on liquidus surfaces using the FactSage software and databases and the Mesh Adaptive Direct Search algorithm journal September 2011
Probability book January 2010
Apprentice for Event Generator Tuning journal January 2021
Monte Carlo-minimization approach to the multiple-minima problem in protein folding. journal October 1987
Multistart global optimization with tunnelling and an evolutionary strategy supervised by a martingale journal July 2021
Quantum Approximate Optimization Algorithm: Performance, Mechanism, and Implementation on Near-Term Devices journal June 2020
Multistart Methods for Quantum Approximate optimization conference September 2019
The true destination of EGO is multi-local optimization conference November 2017
SOMS: SurrOgate MultiStart algorithm for use with nonlinear programming for global optimization journal June 2015
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise journal March 1964
Benchmarking Derivative-Free Optimization Algorithms journal January 2009
ASTRO-DF: A Class of Adaptive Sampling Trust-Region Algorithms for Derivative-Free Stochastic Optimization journal January 2018
SNOBFIT -- Stable Noisy Optimization by Branch and Fit journal July 2008
Improving the Flexibility and Robustness of Model-based Derivative-free Optimization Solvers journal September 2019
Bayesian Optimization book October 2018
A Discussion of Random Methods for Seeking Maxima journal April 1958
On the diffusion approximation of nonconvex stochastic gradient descent journal January 2019
A Quantum Approximate Optimization Algorithm preprint January 2014
A Quantum Approximate Optimization Algorithm Applied to a Bounded Occurrence Constraint Problem preprint January 2014
Budgeted Batch Bayesian Optimization With Unknown Batch Sizes preprint January 2017

Similar Records

Asynchronously parallel optimization solver for finding multiple minima
Journal Article · 2018 · Mathematical Programming Computation · OSTI ID:1466333

Stochastic level-set method for shape optimisation
Journal Article · 2017 · Journal of Computational Physics · OSTI ID:22701617

A Convergence Analysis of Unconstrained and Bound Constrained Evolutionary Pattern Search
Journal Article · 1999 · Evolutionary Computation · OSTI ID:5908

Related Subjects