skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SOP: parallel surrogate global optimization with Pareto center selection for computationally expensive single objective problems

Journal Article · · Journal of Global Optimization
; ;

This paper presents a parallel surrogate-based global optimization method for computationally expensive objective functions that is more effective for larger numbers of processors. To reach this goal, we integrated concepts from multi-objective optimization and tabu search into, single objective, surrogate optimization. Our proposed derivative-free algorithm, called SOP, uses non-dominated sorting of points for which the expensive function has been previously evaluated. The two objectives are the expensive function value of the point and the minimum distance of the point to previously evaluated points. Based on the results of non-dominated sorting, P points from the sorted fronts are selected as centers from which many candidate points are generated by random perturbations. Based on surrogate approximation, the best candidate point is subsequently selected for expensive evaluation for each of the P centers, with simultaneous computation on P processors. Centers that previously did not generate good solutions are tabu with a given tenure. We show almost sure convergence of this algorithm under some conditions. The performance of SOP is compared with two RBF based methods. The test results show that SOP is an efficient method that can reduce time required to find a good near optimal solution. In a number of cases the efficiency of SOP is so good that SOP with 8 processors found an accurate answer in less wall-clock time than the other algorithms did with 32 processors.

Research Organization:
Cornell Univ., Ithaca, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
Grant/Contract Number:
SC000 6791; SC0006791
OSTI ID:
1328968
Alternate ID(s):
OSTI ID: 1425456
Journal Information:
Journal of Global Optimization, Journal Name: Journal of Global Optimization Vol. 66 Journal Issue: 3; ISSN 0925-5001
Publisher:
Springer Science + Business MediaCopyright Statement
Country of Publication:
Netherlands
Language:
English
Citation Metrics:
Cited by: 24 works
Citation information provided by
Web of Science

References (21)

Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems journal April 2014
Globally-biased Disimpl algorithm for expensive global optimization journal April 2014
Watershed calibration using multistart local optimization and evolutionary optimization with radial basis function approximation journal June 2007
Efficient Global Optimization of Expensive Black-Box Functions journal January 1998
Parallel Stochastic Global Optimization Using Radial Basis Functions journal August 2009
MOI-MBO: Multiobjective Infill for Parallel Model-Based Optimization book January 2014
Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection journal February 2015
Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization journal May 2013
Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models journal March 2006
Global optimization of expensive black box functions using potential Lipschitz constants and response surfaces journal March 2015
Efficient global optimization algorithm assisted by multiple surrogate techniques journal March 2012
Local Function Approximation in Evolutionary Algorithms for the Optimization of Costly Functions journal October 2004
A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions journal November 2007
A parallel updating scheme for approximating and optimizing high fidelity computer simulations journal June 2004
Improved evolutionary optimization from genetically adaptive multimethod search journal January 2007
A rigorous framework for optimization of expensive functions by surrogates journal February 1999
Asynchronous Parallel Pattern Search for Nonlinear Optimization journal January 2001
Multiple-optima search method based on a metamodel and mathematical morphology journal February 2015
Comparison of Optimization Methods for Ground-Water Bioremediation journal January 1999
On the Design of Optimization Strategies Based on Global Response Surface Approximation Models journal September 2005
Comparison of function approximation, heuristic, and derivative-based methods for automatic calibration of computationally expensive groundwater bioremediation models: COMPARISON OF OPTIMIZATION METHODS journal November 2005

Cited By (2)

Multi-surrogate-based global optimization using a score-based infill criterion journal September 2018
On the choice of the low-dimensional domain for global optimization via random embeddings journal October 2019

Similar Records

Related Subjects

97 MATHEMATICS AND COMPUTING