skip to main content

DOE PAGESDOE PAGES

  • DOE PAGES
  • Accepted Manuscript: Stochastic derivative-free optimization using a trust region framework

Title: Stochastic derivative-free optimization using a trust region framework

This study presents a trust region algorithm to minimize a function f when one has access only to noise-corrupted function values f¯. The model-based algorithm dynamically adjusts its step length, taking larger steps when the model and function agree and smaller steps when the model is less accurate. The method does not require the user to specify a fixed pattern of points used to build local models and does not repeatedly sample points. If f is sufficiently smooth and the noise is independent and identically distributed with mean zero and finite variance, we prove that our algorithm produces iterates such that the corresponding function gradients converge in probability to zero. As a result, we present a prototype of our algorithm that, while simplistic in its management of previously evaluated points, solves benchmark problems in fewer function evaluations than do existing stochastic approximation methods.
Authors:
 [1] ;  [2]
+ Show Author Affiliations
  1. Argonne National Lab. (ANL), Lemont, IL (United States)
  2. Univ. of Colorado, Denver, CO (United States)
Publication Date:
Grant/Contract Number:
AC02-06CH11357
Type:
Accepted Manuscript
Journal Name:
Computational Optimization and applications
Additional Journal Information:
Journal Volume: 64; Journal Issue: 3; Journal ID: ISSN 0926-6003
Publisher:
Springer
Research Org:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; derivative-free optimization; model-based trust region methods; stochastic optimization
OSTI Identifier:
1366470