DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization

Abstract

In this paper, we present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend themore » authors' moment matching scenario generation algorithm to a probabilistic algorithm that finds optimal probability distributions subject to moment constraints. The combination of this distribution optimization method and the central cutting surface algorithm yields a solution to a family of distributionally robust optimization problems that are considerably more general than the ones proposed to date.« less

Authors:
 [1];  [1]
  1. Northwestern Univ., Evanston, IL (United States)
Publication Date:
Research Org.:
Northwestern Univ., Evanston, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF)
OSTI Identifier:
1321089
Grant/Contract Number:  
SC0005102; CMMI-1100868; SP0011568
Resource Type:
Accepted Manuscript
Journal Name:
SIAM Journal on Optimization
Additional Journal Information:
Journal Volume: 24; Journal Issue: 4; Journal ID: ISSN 1052-6234
Publisher:
SIAM
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; semi-infinite programming; robust optimization; distributionally robust optimization; stochastic programming; moment matching; column generation; cutting surface methods; cutting plane methods; moment problem

Citation Formats

Mehrotra, Sanjay, and Papp, Dávid. A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization. United States: N. p., 2014. Web. doi:10.1137/130925013.
Mehrotra, Sanjay, & Papp, Dávid. A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization. United States. https://doi.org/10.1137/130925013
Mehrotra, Sanjay, and Papp, Dávid. Thu . "A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization". United States. https://doi.org/10.1137/130925013. https://www.osti.gov/servlets/purl/1321089.
@article{osti_1321089,
title = {A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization},
author = {Mehrotra, Sanjay and Papp, Dávid},
abstractNote = {In this paper, we present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend the authors' moment matching scenario generation algorithm to a probabilistic algorithm that finds optimal probability distributions subject to moment constraints. The combination of this distribution optimization method and the central cutting surface algorithm yields a solution to a family of distributionally robust optimization problems that are considerably more general than the ones proposed to date.},
doi = {10.1137/130925013},
journal = {SIAM Journal on Optimization},
number = 4,
volume = 24,
place = {United States},
year = {Thu Oct 16 00:00:00 EDT 2014},
month = {Thu Oct 16 00:00:00 EDT 2014}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 36 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

On the von Neumann and Frank--Wolfe Algorithms with Away Steps
journal, January 2016

  • Pen͂a, Javier; Rodríguez, Daniel; Soheili, Negar
  • SIAM Journal on Optimization, Vol. 26, Issue 1
  • DOI: 10.1137/15M1009937

New Douglas--Rachford Algorithmic Structures and Their Convergence Analyses
journal, January 2016

  • Censor, Yair; Mansour, Rafiq
  • SIAM Journal on Optimization, Vol. 26, Issue 1
  • DOI: 10.1137/141001536

Solving Generalized CDT Problems via Two-Parameter Eigenvalues
journal, January 2016

  • Sakaue, Shinsaku; Nakatsukasa, Yuji; Takeda, Akiko
  • SIAM Journal on Optimization, Vol. 26, Issue 3
  • DOI: 10.1137/15100624X

A Two-Variable Approach to the Two-Trust-Region Subproblem
journal, January 2016

  • Yang, Boshi; Burer, Samuel
  • SIAM Journal on Optimization, Vol. 26, Issue 1
  • DOI: 10.1137/130945880

A Note on Polynomial Solvability of the CDT Problem
journal, January 2016

  • Bienstock, Daniel
  • SIAM Journal on Optimization, Vol. 26, Issue 1
  • DOI: 10.1137/15M1009871

Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion
journal, August 2010

  • Bertsimas, Dimitris; Doan, Xuan Vinh; Natarajan, Karthik
  • Mathematics of Operations Research, Vol. 35, Issue 3
  • DOI: 10.1287/moor.1100.0445

An accelerated central cutting plane algorithm for linear semi-infinite programming
journal, July 2004


The complexity of optimizing over a simplex, hypercube or sphere: a short survey
journal, December 2007


A PTAS for the minimization of polynomials of fixed degree over the simplex
journal, September 2006

  • de Klerk, Etienne; Laurent, Monique; Parrilo, Pablo A.
  • Theoretical Computer Science, Vol. 361, Issue 2-3
  • DOI: 10.1016/j.tcs.2006.05.011

FPTAS for optimizing polynomials over the mixed-integer points of polytopes in fixed dimension
journal, September 2007

  • De Loera, Jesús A.; Hemmecke, Raymond; Köppe, Matthias
  • Mathematical Programming, Vol. 115, Issue 2
  • DOI: 10.1007/s10107-007-0175-8

Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems
journal, June 2010


GloptiPoly: Global optimization over polynomials with Matlab and SeDuMi
journal, June 2003

  • Henrion, Didier; Lasserre, Jean-Bernard
  • ACM Transactions on Mathematical Software, Vol. 29, Issue 2
  • DOI: 10.1145/779359.779363

An empirical evaluation of walk-and-round heuristics for mixed integer linear programs
journal, February 2013

  • Huang, Kuo-Ling; Mehrotra, Sanjay
  • Computational Optimization and Applications, Vol. 55, Issue 3
  • DOI: 10.1007/s10589-013-9540-0

Random Walks on Polytopes and an Affine Interior Point Method for Linear Programming
journal, February 2012

  • Kannan, Ravindran; Narayanan, Hariharan
  • Mathematics of Operations Research, Vol. 37, Issue 1
  • DOI: 10.1287/moor.1110.0519

Multivariate distributions and the moment problem
journal, January 2013


A Central Cutting Plane Algorithm for Convex Semi-Infinite Programming Problems
journal, November 1993

  • Kortanek, K. O.; No, Hoon
  • SIAM Journal on Optimization, Vol. 3, Issue 4
  • DOI: 10.1137/0803047

Semi-infinite programming
journal, July 2007


Hit-and-Run from a Corner
journal, January 2006


Generating Moment Matching Scenarios Using Optimization Techniques
journal, January 2013

  • Mehrotra, Sanjay; Papp, Dávid
  • SIAM Journal on Optimization, Vol. 23, Issue 2
  • DOI: 10.1137/110858082

Semidefinite programming relaxations for semialgebraic problems
journal, May 2003


A cutting-plane method for quadratic semi infinite programming problems
journal, January 1988


Sums of Squares and Semidefinite Program Relaxations for Polynomial Optimization Problems with Structured Sparsity
journal, January 2006

  • Waki, Hayato; Kim, Sunyoung; Kojima, Masakazu
  • SIAM Journal on Optimization, Vol. 17, Issue 1
  • DOI: 10.1137/050623802

Works referencing / citing this record:

Data-Driven Stochastic Programming Using Phi-Divergences
book, September 2015


Scenario reduction for stochastic programs with Conditional Value-at-Risk
journal, May 2018

  • Arpón, Sebastián; Homem-de-Mello, Tito; Pagnoncelli, Bernardo
  • Mathematical Programming, Vol. 170, Issue 1
  • DOI: 10.1007/s10107-018-1298-9

An inexact primal-dual algorithm for semi-infinite programming
journal, January 2020

  • Wei, Bo; Haskell, William B.; Zhao, Sixiang
  • Mathematical Methods of Operations Research, Vol. 91, Issue 3
  • DOI: 10.1007/s00186-019-00698-2

Quantitative stability analysis for minimax distributionally robust risk optimization
journal, November 2018


Robust unit commitment with $$n-1$$ n - 1 security criteria
journal, February 2016

  • Gourtani, Arash; Xu, Huifu; Pozo, David
  • Mathematical Methods of Operations Research, Vol. 83, Issue 3
  • DOI: 10.1007/s00186-016-0532-6