skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Multi-Objective Bayesian Optimization Approach Using the Weighted Tchebycheff Method

Journal Article · · Journal of Mechanical Design
DOI:https://doi.org/10.1115/1.4051787· OSTI ID:1980664

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard multi-objective (MO) optimization problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontiers. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a prior knowledge. Therefore, in this paper, we develop a MO-BO framework where we calibrate with multiple linear regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed MO-BO. These iteratively estimated mean utopia values are used to formulate the weighted Tchebycheff MO acquisition function. The proposed approach is implemented in two numerical test examples and one engineering design problem of optimizing thin tube geometries under constant loading of temperature and pressure, with minimizing the risk of creep-fatigue failure and design cost, along with risk-based and manufacturing constraints. Finally, the model accuracy with frequentist, Bayesian and without MLR-based calibration are compared to true Pareto solutions.

Research Organization:
Oregon State Univ., Corvallis, OR (United States)
Sponsoring Organization:
USDOE Office of Nuclear Energy (NE)
DOE Contract Number:
NE0008533
OSTI ID:
1980664
Journal Information:
Journal of Mechanical Design, Vol. 144, Issue 1; ISSN 1050-0472
Publisher:
ASME
Country of Publication:
United States
Language:
English

References (30)

An Optimization Framework for Wind Farm Design in Complex Terrain journal October 2018
An Optimization Framework of Multiobjective Artificial Bee Colony Algorithm Based on the MOEA Framework journal November 2018
Multifidelity and Multiscale Bayesian Framework for High-Dimensional Engineering Design and Calibration journal September 2019
Learning an Optimization Algorithm Through Human Design Iterations journal August 2017
A New Multi-Objective Bayesian Optimization Formulation With the Acquisition Function for Convergence and Diversity journal March 2020
Elastic-plastic behaviour of thin tubes subjected to internal pressure and intermittent high-heat fluxes with application to fast-nuclear-reactor fuel elements journal July 1967
Feasibility of Using Diffusion Bonding for Producing Hybrid Printed Circuit Heat Exchangers for Nuclear Energy Applications journal January 2018
Tchebycheff norms in multi-objective linear programming journal January 1993
Revisiting norm optimization for multi-objective black-box problems: a finite-time analysis journal September 2018
A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot journal August 2009
A law of comparative judgment. journal January 1927
Bayesian auxiliary variable models for binary and multinomial regression journal March 2006
The effect of the nugget on Gaussian process emulators of computer models journal December 2012
Shared-Gaussian Process: Learning Interpretable Shared Hidden Structure Across Data Spaces for Design Space Analysis and Exploration journal March 2020
Globally Approximate Gaussian Processes for Big Data With Application to Data-Driven Metamaterials Design journal September 2019
Taking the Human Out of the Loop: A Review of Bayesian Optimization journal January 2016
Comparison of Gaussian process modeling software journal April 2018
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise journal March 1964
A Taxonomy of Global Optimization Methods Based on Response Surfaces journal December 2001
A statistical method for global optimization conference January 1992
Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels journal August 2006
Multi-Objective Bayesian Global Optimization using expected hypervolume improvement gradient journal February 2019
srMO-BO-3GP: A Sequential Regularized Multi-Objective Constrained Bayesian Optimization for Design Applications
  • Tran, Anh; Eldred, Mike; McCann, Scott
  • ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 9: 40th Computers and Information in Engineering Conference (CIE) https://doi.org/10.1115/DETC2020-22184
conference November 2020
Applications of Multiobjective Optimization in Chemical Engineering journal January 2000
Weighted Tchebycheff Optimization Technique Under Uncertainty journal March 2020
Improved rank‐niche evolution strategy algorithm for constrained multiobjective optimization journal May 2008
A fast and elitist multiobjective genetic algorithm: NSGA-II journal April 2002
Review: Multi-objective optimization methods and application in energy saving journal April 2017
Survey of multi-objective optimization methods for engineering journal April 2004
An Approach to Bayesian Optimization for Design Feasibility Check on Discontinuous Black-Box Functions journal February 2021