A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization
Abstract
In this paper, we present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend themore »
- Authors:
-
- Northwestern Univ., Evanston, IL (United States)
- Publication Date:
- Research Org.:
- Northwestern Univ., Evanston, IL (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF)
- OSTI Identifier:
- 1321089
- Grant/Contract Number:
- SC0005102; CMMI-1100868; SP0011568
- Resource Type:
- Accepted Manuscript
- Journal Name:
- SIAM Journal on Optimization
- Additional Journal Information:
- Journal Volume: 24; Journal Issue: 4; Journal ID: ISSN 1052-6234
- Publisher:
- SIAM
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; semi-infinite programming; robust optimization; distributionally robust optimization; stochastic programming; moment matching; column generation; cutting surface methods; cutting plane methods; moment problem
Citation Formats
Mehrotra, Sanjay, and Papp, Dávid. A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization. United States: N. p., 2014.
Web. doi:10.1137/130925013.
Mehrotra, Sanjay, & Papp, Dávid. A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization. United States. https://doi.org/10.1137/130925013
Mehrotra, Sanjay, and Papp, Dávid. Thu .
"A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization". United States. https://doi.org/10.1137/130925013. https://www.osti.gov/servlets/purl/1321089.
@article{osti_1321089,
title = {A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization},
author = {Mehrotra, Sanjay and Papp, Dávid},
abstractNote = {In this paper, we present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend the authors' moment matching scenario generation algorithm to a probabilistic algorithm that finds optimal probability distributions subject to moment constraints. The combination of this distribution optimization method and the central cutting surface algorithm yields a solution to a family of distributionally robust optimization problems that are considerably more general than the ones proposed to date.},
doi = {10.1137/130925013},
journal = {SIAM Journal on Optimization},
number = 4,
volume = 24,
place = {United States},
year = {Thu Oct 16 00:00:00 EDT 2014},
month = {Thu Oct 16 00:00:00 EDT 2014}
}
Web of Science
Works referenced in this record:
On the von Neumann and Frank--Wolfe Algorithms with Away Steps
journal, January 2016
- Pen͂a, Javier; Rodríguez, Daniel; Soheili, Negar
- SIAM Journal on Optimization, Vol. 26, Issue 1
New Douglas--Rachford Algorithmic Structures and Their Convergence Analyses
journal, January 2016
- Censor, Yair; Mansour, Rafiq
- SIAM Journal on Optimization, Vol. 26, Issue 1
Solving Generalized CDT Problems via Two-Parameter Eigenvalues
journal, January 2016
- Sakaue, Shinsaku; Nakatsukasa, Yuji; Takeda, Akiko
- SIAM Journal on Optimization, Vol. 26, Issue 3
A Two-Variable Approach to the Two-Trust-Region Subproblem
journal, January 2016
- Yang, Boshi; Burer, Samuel
- SIAM Journal on Optimization, Vol. 26, Issue 1
A Note on Polynomial Solvability of the CDT Problem
journal, January 2016
- Bienstock, Daniel
- SIAM Journal on Optimization, Vol. 26, Issue 1
Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion
journal, August 2010
- Bertsimas, Dimitris; Doan, Xuan Vinh; Natarajan, Karthik
- Mathematics of Operations Research, Vol. 35, Issue 3
An accelerated central cutting plane algorithm for linear semi-infinite programming
journal, July 2004
- Betr�, Bruno
- Mathematical Programming, Vol. 101, Issue 3
The complexity of optimizing over a simplex, hypercube or sphere: a short survey
journal, December 2007
- de Klerk, Etienne
- Central European Journal of Operations Research, Vol. 16, Issue 2
A PTAS for the minimization of polynomials of fixed degree over the simplex
journal, September 2006
- de Klerk, Etienne; Laurent, Monique; Parrilo, Pablo A.
- Theoretical Computer Science, Vol. 361, Issue 2-3
FPTAS for optimizing polynomials over the mixed-integer points of polytopes in fixed dimension
journal, September 2007
- De Loera, Jesús A.; Hemmecke, Raymond; Köppe, Matthias
- Mathematical Programming, Vol. 115, Issue 2
Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems
journal, June 2010
- Delage, Erick; Ye, Yinyu
- Operations Research, Vol. 58, Issue 3
GloptiPoly: Global optimization over polynomials with Matlab and SeDuMi
journal, June 2003
- Henrion, Didier; Lasserre, Jean-Bernard
- ACM Transactions on Mathematical Software, Vol. 29, Issue 2
An empirical evaluation of walk-and-round heuristics for mixed integer linear programs
journal, February 2013
- Huang, Kuo-Ling; Mehrotra, Sanjay
- Computational Optimization and Applications, Vol. 55, Issue 3
Random Walks on Polytopes and an Affine Interior Point Method for Linear Programming
journal, February 2012
- Kannan, Ravindran; Narayanan, Hariharan
- Mathematics of Operations Research, Vol. 37, Issue 1
Multivariate distributions and the moment problem
journal, January 2013
- Kleiber, Christian; Stoyanov, Jordan
- Journal of Multivariate Analysis, Vol. 113
A Central Cutting Plane Algorithm for Convex Semi-Infinite Programming Problems
journal, November 1993
- Kortanek, K. O.; No, Hoon
- SIAM Journal on Optimization, Vol. 3, Issue 4
Semi-infinite programming
journal, July 2007
- López, Marco; Still, Georg
- European Journal of Operational Research, Vol. 180, Issue 2
Hit-and-Run from a Corner
journal, January 2006
- Lovász, László; Vempala, Santosh
- SIAM Journal on Computing, Vol. 35, Issue 4
Generating Moment Matching Scenarios Using Optimization Techniques
journal, January 2013
- Mehrotra, Sanjay; Papp, Dávid
- SIAM Journal on Optimization, Vol. 23, Issue 2
Semidefinite programming relaxations for semialgebraic problems
journal, May 2003
- Parrilo, Pablo A.
- Mathematical Programming, Vol. 96, Issue 2
A cutting-plane method for quadratic semi infinite programming problems
journal, January 1988
- Tichatschke, R.; Nebeling, V.
- Optimization, Vol. 19, Issue 6
Sums of Squares and Semidefinite Program Relaxations for Polynomial Optimization Problems with Structured Sparsity
journal, January 2006
- Waki, Hayato; Kim, Sunyoung; Kojima, Masakazu
- SIAM Journal on Optimization, Vol. 17, Issue 1
Works referencing / citing this record:
Data-Driven Stochastic Programming Using Phi-Divergences
book, September 2015
- Bayraksan, Güzin; Love, David K.
- The Operations Research Revolution
Scenario reduction for stochastic programs with Conditional Value-at-Risk
journal, May 2018
- Arpón, Sebastián; Homem-de-Mello, Tito; Pagnoncelli, Bernardo
- Mathematical Programming, Vol. 170, Issue 1
An inexact primal-dual algorithm for semi-infinite programming
journal, January 2020
- Wei, Bo; Haskell, William B.; Zhao, Sixiang
- Mathematical Methods of Operations Research, Vol. 91, Issue 3
Quantitative stability analysis for minimax distributionally robust risk optimization
journal, November 2018
- Pichler, Alois; Xu, Huifu
- Mathematical Programming
Robust unit commitment with $$n-1$$ n - 1 security criteria
journal, February 2016
- Gourtani, Arash; Xu, Huifu; Pozo, David
- Mathematical Methods of Operations Research, Vol. 83, Issue 3