DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A survey of nonlinear robust optimization

Abstract

Robust optimization (RO) has attracted great attention from the optimization community over the past decade. RO is dedicated to solving optimization problems subject to uncertainty: design constraints must be satisfied for all the values of the uncertain parameters within a given uncertainty set. Uncertainty sets may be modeled as deterministic sets (boxes, polyhedra, ellipsoids), in which case the RO problem may be reformulated via worst-case analysis, or as families of distributions. The challenge of RO is to reformulate or approximate robust constraints so that the uncertain optimization problem is transformed into a tractable deterministic optimization problem. Most reformulation methods assume linearity of the robust constraints or uncertainty sets of favorable shape, which represents only a fraction of real-world applications. This survey addresses nonlinear RO and includes problem formulations and applications, solution approaches, and available software with code samples.

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. Argonne National Lab. (ANL), Lemont, IL (United States)
Publication Date:
Research Org.:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI Identifier:
1660707
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Accepted Manuscript
Journal Name:
INFOR. Information Systems and Operational Research
Additional Journal Information:
Journal Volume: 58; Journal Issue: 2; Journal ID: ISSN 0315-5986
Publisher:
Taylor & Francis
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Nonlinear robust optimization

Citation Formats

Leyffer, Sven, Menickelly, Matt, Munson, Todd, Vanaret, Charlie, and Wild, Stefan M. A survey of nonlinear robust optimization. United States: N. p., 2020. Web. doi:10.1080/03155986.2020.1730676.
Leyffer, Sven, Menickelly, Matt, Munson, Todd, Vanaret, Charlie, & Wild, Stefan M. A survey of nonlinear robust optimization. United States. https://doi.org/10.1080/03155986.2020.1730676
Leyffer, Sven, Menickelly, Matt, Munson, Todd, Vanaret, Charlie, and Wild, Stefan M. Tue . "A survey of nonlinear robust optimization". United States. https://doi.org/10.1080/03155986.2020.1730676. https://www.osti.gov/servlets/purl/1660707.
@article{osti_1660707,
title = {A survey of nonlinear robust optimization},
author = {Leyffer, Sven and Menickelly, Matt and Munson, Todd and Vanaret, Charlie and Wild, Stefan M.},
abstractNote = {Robust optimization (RO) has attracted great attention from the optimization community over the past decade. RO is dedicated to solving optimization problems subject to uncertainty: design constraints must be satisfied for all the values of the uncertain parameters within a given uncertainty set. Uncertainty sets may be modeled as deterministic sets (boxes, polyhedra, ellipsoids), in which case the RO problem may be reformulated via worst-case analysis, or as families of distributions. The challenge of RO is to reformulate or approximate robust constraints so that the uncertain optimization problem is transformed into a tractable deterministic optimization problem. Most reformulation methods assume linearity of the robust constraints or uncertainty sets of favorable shape, which represents only a fraction of real-world applications. This survey addresses nonlinear RO and includes problem formulations and applications, solution approaches, and available software with code samples.},
doi = {10.1080/03155986.2020.1730676},
journal = {INFOR. Information Systems and Operational Research},
number = 2,
volume = 58,
place = {United States},
year = {Tue Mar 17 00:00:00 EDT 2020},
month = {Tue Mar 17 00:00:00 EDT 2020}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 21 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Hidden conic quadratic representation of some nonconvex quadratic optimization problems
journal, September 2013


A derivative-free approximate gradient sampling algorithm for finite minimax problems
journal, March 2013


Robust optimization – A comprehensive survey
journal, July 2007

  • Beyer, Hans-Georg; Sendhoff, Bernhard
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 33-34
  • DOI: 10.1016/j.cma.2007.03.003

A survey of adjustable robust optimization
journal, September 2019

  • Yanıkoğlu, İhsan; Gorissen, Bram L.; den Hertog, Dick
  • European Journal of Operational Research, Vol. 277, Issue 3
  • DOI: 10.1016/j.ejor.2018.08.031

Distributionally Robust Convex Optimization
journal, December 2014

  • Wiesemann, Wolfram; Kuhn, Daniel; Sim, Melvyn
  • Operations Research, Vol. 62, Issue 6
  • DOI: 10.1287/opre.2014.1314

Robust support vector machines for classification and computational issues
journal, February 2007


Safe Approximations of Ambiguous Chance Constraints Using Historical Data
journal, November 2013

  • Yanıkoğlu, İhsan; den Hertog, Dick
  • INFORMS Journal on Computing, Vol. 25, Issue 4
  • DOI: 10.1287/ijoc.1120.0529

Cutting plane versus compact formulations for uncertain (integer) linear programs
journal, April 2012


Bilevel derivative-free optimization and its application to robust optimization
journal, June 2012


An approximation technique for robust nonlinear optimization
journal, December 2005

  • Diehl, Moritz; Bock, Hans Georg; Kostina, Ekaterina
  • Mathematical Programming, Vol. 107, Issue 1-2
  • DOI: 10.1007/s10107-005-0685-1

ROPI—a robust optimization programming interface for C++
journal, February 2014


Data-driven chance constrained stochastic program
journal, July 2015


Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations
journal, July 2017


Interior-Point Algorithms, Penalty Methods and Equilibrium Problems
journal, March 2006

  • Benson, Hande Y.; Sen, Arun; Shanno, David F.
  • Computational Optimization and Applications, Vol. 34, Issue 2
  • DOI: 10.1007/s10589-005-3908-8

Modeling and solving uncertain optimization problems in YALMIP
journal, January 2008


Global Convergence of an Elastic Mode Approach for a Class of Mathematical Programs with Complementarity Constraints
journal, January 2005

  • Anitescu, Mihai
  • SIAM Journal on Optimization, Vol. 16, Issue 1
  • DOI: 10.1137/040606855

Theory and Applications of Robust Optimization
journal, January 2011

  • Bertsimas, Dimitris; Brown, David B.; Caramanis, Constantine
  • SIAM Review, Vol. 53, Issue 3
  • DOI: 10.1137/080734510

Nonlinear MPC of kites under varying wind conditions for a new class of large-scale wind power generators
journal, January 2007

  • Ilzhöfer, A.; Houska, B.; Diehl, M.
  • International Journal of Robust and Nonlinear Control, Vol. 17, Issue 17
  • DOI: 10.1002/rnc.1210

Robust Control of Markov Decision Processes with Uncertain Transition Matrices
journal, October 2005


Robust Truss Topology Design via Semidefinite Programming
journal, November 1997


Robust convex quadratically constrained programs
journal, August 2003


The adaptive convexification algorithm for semi-infinite programming with arbitrary index sets
journal, May 2012


A successive SDP-NSDP approach to a robust optimization problem in finance
journal, January 2008


A Robust Optimization Approach for Magnetic Spacecraft Attitude Stabilization
journal, November 2016

  • Bruni, Renato; Celani, Fabio
  • Journal of Optimization Theory and Applications, Vol. 173, Issue 3
  • DOI: 10.1007/s10957-016-1035-6

A practical guide to robust optimization
journal, June 2015


Uncertainty analysis and robust optimization of multiscale process systems with application to epitaxial thin film growth
journal, September 2014


Model Order Reduction Techniques with a Posteriori Error Control for Nonlinear Robust Optimization Governed by Partial Differential Equations
journal, January 2017

  • Lass, Oliver; Ulbrich, Stefan
  • SIAM Journal on Scientific Computing, Vol. 39, Issue 5
  • DOI: 10.1137/16M108269X

Expected improvement based infill sampling for global robust optimization of constrained problems
journal, January 2017


Interior Methods for Mathematical Programs with Complementarity Constraints
journal, January 2006

  • Leyffer, Sven; López-Calva, Gabriel; Nocedal, Jorge
  • SIAM Journal on Optimization, Vol. 17, Issue 1
  • DOI: 10.1137/040621065

Robust Convex Optimization
journal, November 1998

  • Ben-Tal, A.; Nemirovski, A.
  • Mathematics of Operations Research, Vol. 23, Issue 4
  • DOI: 10.1287/moor.23.4.769

Robust optimization ? methodology and applications
journal, May 2002

  • Ben-Tal, Aharon; Nemirovski, Arkadi
  • Mathematical Programming, Vol. 92, Issue 3
  • DOI: 10.1007/s101070100286

Process scheduling under uncertainty: Review and challenges
journal, April 2008


A log-robust optimization approach to portfolio management
journal, January 2009


Matrix Sum-of-Squares Relaxations for Robust Semi-Definite Programs
journal, December 2005


Robust Dynamic Optimization of a Semi-Batch Emulsion Polymerization Process with Parametric Uncertainties-A Heuristic Approach -
journal, January 2016


A Distributional Interpretation of Robust Optimization
journal, February 2012

  • Xu, Huan; Caramanis, Constantine; Mannor, Shie
  • Mathematics of Operations Research, Vol. 37, Issue 1
  • DOI: 10.1287/moor.1110.0531

A two-sided relaxation scheme for Mathematical Programs with Equilibrium Constraints
journal, January 2005

  • DeMiguel, Victor; Friedlander, Michael P.; Nogales, Francisco J.
  • SIAM Journal on Optimization, Vol. 16, Issue 2
  • DOI: 10.1137/04060754x

Optimization of conditional value-at-risk
journal, January 2000

  • Rockafellar, R. Tyrrell; Uryasev, Stanislav
  • The Journal of Risk, Vol. 2, Issue 3
  • DOI: 10.21314/JOR.2000.038

Short sales in Log-robust portfolio management
journal, December 2011


Solving mathematical programs with complementarity constraints as nonlinear programs
journal, February 2004


Recent advances in robust optimization: An overview
journal, June 2014

  • Gabrel, Virginie; Murat, Cécile; Thiele, Aurélie
  • European Journal of Operational Research, Vol. 235, Issue 3
  • DOI: 10.1016/j.ejor.2013.09.036

Robust Solutions of Optimization Problems Affected by Uncertain Probabilities
journal, February 2013

  • Ben-Tal, Aharon; den Hertog, Dick; De Waegenaere, Anja
  • Management Science, Vol. 59, Issue 2
  • DOI: 10.1287/mnsc.1120.1641

A Second Order Approximation Technique for Robust Shape Optimization
journal, September 2011


Robust Assortment Optimization in Revenue Management Under the Multinomial Logit Choice Model
journal, August 2012

  • Rusmevichientong, Paat; Topaloglu, Huseyin
  • Operations Research, Vol. 60, Issue 4
  • DOI: 10.1287/opre.1120.1063

Robust airfoil optimization to achieve drag reduction over a range of Mach numbers
journal, August 2002

  • Li, W.; Huyse, L.; Padula, S.
  • Structural and Multidisciplinary Optimization, Vol. 24, Issue 1
  • DOI: 10.1007/s00158-002-0212-4

An Interior Point Method for Mathematical Programs with Complementarity Constraints (MPCCs)
journal, January 2005


Robust Optimization Made Easy with ROME
journal, August 2011


Computationally Tractable Counterparts of Distributionally Robust Constraints on Risk Measures
journal, January 2016

  • Postek, Krzysztof; den Hertog, Dick; Melenberg, Bertrand
  • SIAM Review, Vol. 58, Issue 4
  • DOI: 10.1137/151005221

Solving Semi-Infinite Optimization Problems with Interior Point Techniques
journal, January 2003


Some outer approximation methods for semi-infinite optimization problems
journal, July 1994


Robust Optimization
book, December 2009

  • Ben-Tal, Aharon; El Ghaoui, Laurent; Nemirovski, Arkadi
  • Princeton Series in Applied Mathematics
  • DOI: 10.1515/9781400831050

Likelihood robust optimization for data-driven problems
journal, September 2015


Worst-Case Value-At-Risk and Robust Portfolio Optimization: A Conic Programming Approach
journal, August 2003


Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems
journal, June 2010


Convex Approximations of Chance Constrained Programs
journal, January 2007

  • Nemirovski, Arkadi; Shapiro, Alexander
  • SIAM Journal on Optimization, Vol. 17, Issue 4
  • DOI: 10.1137/050622328

Robust Portfolio Selection Problems
journal, February 2003


Chance constrained uncertain classification via robust optimization
journal, October 2010

  • Ben-Tal, Aharon; Bhadra, Sahely; Bhattacharyya, Chiranjib
  • Mathematical Programming, Vol. 127, Issue 1
  • DOI: 10.1007/s10107-010-0415-1

Deriving robust counterparts of nonlinear uncertain inequalities
journal, February 2014

  • Ben-Tal, Aharon; den Hertog, Dick; Vial, Jean-Philippe
  • Mathematical Programming, Vol. 149, Issue 1-2
  • DOI: 10.1007/s10107-014-0750-8

Robust portfolio optimization with derivative insurance guarantees
journal, April 2011

  • Zymler, Steve; Rustem, Berç; Kuhn, Daniel
  • European Journal of Operational Research, Vol. 210, Issue 2
  • DOI: 10.1016/j.ejor.2010.09.027

A Robust SQP Method for Mathematical Programs with Linear Complementarity Constraints
journal, October 2005

  • Liu, Xinwei; Perakis, Georgia; Sun, Jie
  • Computational Optimization and Applications, Vol. 34, Issue 1
  • DOI: 10.1007/s10589-005-3075-y

Robust solutions of uncertain linear programs
journal, August 1999


SIPAMPL: Semi-infinite programming with AMPL
journal, March 2004

  • Vaz, A. Ismael F.; Fernandes, Edite M. G. P.; Gomes, M. Paula S. F.
  • ACM Transactions on Mathematical Software, Vol. 30, Issue 1
  • DOI: 10.1145/974781.974784

Duality in robust optimization: Primal worst equals dual best
journal, January 2009


Data-driven robust optimization
journal, February 2017

  • Bertsimas, Dimitris; Gupta, Vishal; Kallus, Nathan
  • Mathematical Programming, Vol. 167, Issue 2
  • DOI: 10.1007/s10107-017-1125-8

An Outer Approximations Approach to Reliability-Based Optimal Design of Structures
journal, July 1998

  • Kirjner-Neto, C.; Polak, E.; Kiureghian, A. Der
  • Journal of Optimization Theory and Applications, Vol. 98, Issue 1
  • DOI: 10.1023/A:1022647728419

Optimization under Decision-Dependent Uncertainty
journal, January 2018

  • Nohadani, Omid; Sharma, Kartikey
  • SIAM Journal on Optimization, Vol. 28, Issue 2
  • DOI: 10.1137/17M1110560

Local Convergence of SQP Methods for Mathematical Programs with Equilibrium Constraints
journal, January 2006


Derivative-Free Robust Optimization for Circuit Design
journal, October 2013

  • Ciccazzo, Angelo; Latorre, Vittorio; Liuzzi, Giampaolo
  • Journal of Optimization Theory and Applications, Vol. 164, Issue 3
  • DOI: 10.1007/s10957-013-0441-2

Robust Solutions to Uncertain Semidefinite Programs
journal, January 1998

  • El Ghaoui, Laurent; Oustry, Francois; Lebret, Hervé
  • SIAM Journal on Optimization, Vol. 9, Issue 1
  • DOI: 10.1137/S1052623496305717

Robust Regression and Lasso
journal, July 2010

  • Xu, Huan; Caramanis, Constantine; Mannor, Shie
  • IEEE Transactions on Information Theory, Vol. 56, Issue 7
  • DOI: 10.1109/TIT.2010.2048503

Robust PCA via Outlier Pursuit
journal, May 2012

  • Xu, Huan; Caramanis, Constantine; Sanghavi, Sujay
  • IEEE Transactions on Information Theory, Vol. 58, Issue 5
  • DOI: 10.1109/TIT.2011.2173156

Robust portfolio optimization: a conic programming approach
journal, June 2011

  • Ye, Kai; Parpas, Panos; Rustem, Berç
  • Computational Optimization and Applications, Vol. 52, Issue 2
  • DOI: 10.1007/s10589-011-9419-x

A Minimax Theorem with Applications to Machine Learning, Signal Processing, and Finance
journal, January 2008

  • Kim, Seung-Jean; Boyd, Stephen
  • SIAM Journal on Optimization, Vol. 19, Issue 3
  • DOI: 10.1137/060677586

YALMIP : a toolbox for modeling and optimization in MATLAB
conference, January 2004

  • Lofberg, J.
  • 2004 IEEE International Symposium on Computer Aided Control Systems Design, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508)
  • DOI: 10.1109/CACSD.2004.1393890

Symmetry groups, semidefinite programs, and sums of squares
journal, September 2004


Derivative-free optimization methods for finite minimax problems
journal, April 2013


Semi-Infinite Programming: Theory, Methods, and Applications
journal, September 1993

  • Hettich, R.; Kortanek, K. O.
  • SIAM Review, Vol. 35, Issue 3
  • DOI: 10.1137/1035089

Worst-Case Value at Risk of Nonlinear Portfolios
journal, January 2013


Case Studies for a First-Order Robust Nonlinear Programming Formulation
journal, May 2007


Robust Optimization for Unconstrained Simulation-Based Problems
journal, February 2010

  • Bertsimas, Dimitris; Nohadani, Omid; Teo, Kwong Meng
  • Operations Research, Vol. 58, Issue 1
  • DOI: 10.1287/opre.1090.0715

Portfolio Selection with Robust Estimation
journal, June 2009


Distributionally robust joint chance constraints with second-order moment information
journal, November 2011


Robust solutions of Linear Programming problems contaminated with uncertain data
journal, September 2000

  • Ben-Tal, Aharon; Nemirovski, Arkadi
  • Mathematical Programming, Vol. 88, Issue 3
  • DOI: 10.1007/PL00011380

Algorithmic differentiation for piecewise smooth functions: a case study for robust optimization
journal, June 2017

  • Fiege, Sabrina; Walther, Andrea; Kulshreshtha, Kshitij
  • Optimization Methods and Software, Vol. 33, Issue 4-6
  • DOI: 10.1080/10556788.2017.1333613

Robust optimization in electromagnetic scattering problems
journal, April 2007

  • Bertsimas, Dimitris; Nohadani, Omid; Teo, Kwong Meng
  • Journal of Applied Physics, Vol. 101, Issue 7
  • DOI: 10.1063/1.2715540

Distributionally Robust Optimization and Its Tractable Approximations
journal, August 2010


Robust Optimization with Ambiguous Stochastic Constraints Under Mean and Dispersion Information
journal, June 2018

  • Postek, Krzysztof; Ben-Tal, Aharon; den Hertog, Dick
  • Operations Research, Vol. 66, Issue 3
  • DOI: 10.1287/opre.2017.1688

Numerical solution approaches for robust nonlinear optimal control problems
journal, June 2008


Adaptive Distributionally Robust Optimization
journal, February 2019

  • Bertsimas, Dimitris; Sim, Melvyn; Zhang, Meilin
  • Management Science, Vol. 65, Issue 2
  • DOI: 10.1287/mnsc.2017.2952

Nonlinear robust optimization for process design
journal, September 2017

  • Yuan, Yuan; Li, Zukui; Huang, Biao
  • AIChE Journal, Vol. 64, Issue 2
  • DOI: 10.1002/aic.15950

Distributionally Robust Stochastic Programming
journal, January 2017

  • Shapiro, Alexander
  • SIAM Journal on Optimization, Vol. 27, Issue 4
  • DOI: 10.1137/16M1058297

Reformulation versus cutting-planes for robust optimization: A computational study
journal, July 2015

  • Bertsimas, Dimitris; Dunning, Iain; Lubin, Miles
  • Computational Management Science, Vol. 13, Issue 2
  • DOI: 10.1007/s10287-015-0236-z

On Distributionally Robust Chance-Constrained Linear Programs
journal, December 2006

  • Calafiore, G. C.; Ghaoui, L. El
  • Journal of Optimization Theory and Applications, Vol. 130, Issue 1
  • DOI: 10.1007/s10957-006-9084-x

Distributionally robust chance constraints for non-linear uncertainties
journal, November 2014


Robust optimization with simulated annealing
journal, December 2009


TRACTABLE ROBUST EXPECTED UTILITY AND RISK MODELS FOR PORTFOLIO OPTIMIZATION: tractable robust expected utility and risk models
journal, September 2010


Robust Optimization of Large-Scale Systems
journal, April 1995

  • Mulvey, John M.; Vanderbei, Robert J.; Zenios, Stavros A.
  • Operations Research, Vol. 43, Issue 2
  • DOI: 10.1287/opre.43.2.264