DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization

Journal Article · · SIAM Journal on Optimization
DOI: https://doi.org/10.1137/130925013 · OSTI ID:1321089
 [1];  [2]
  1. Northwestern Univ., Evanston, IL (United States); Northwestern University
  2. Northwestern Univ., Evanston, IL (United States)

In this paper, we present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend the authors' moment matching scenario generation algorithm to a probabilistic algorithm that finds optimal probability distributions subject to moment constraints. The combination of this distribution optimization method and the central cutting surface algorithm yields a solution to a family of distributionally robust optimization problems that are considerably more general than the ones proposed to date.

Research Organization:
Northwestern University, Evanston, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21); National Science Foundation (NSF)
Grant/Contract Number:
SC0005102
OSTI ID:
1321089
Journal Information:
SIAM Journal on Optimization, Journal Name: SIAM Journal on Optimization Journal Issue: 4 Vol. 24; ISSN 1052-6234
Publisher:
SIAMCopyright Statement
Country of Publication:
United States
Language:
English

References (22)

The complexity of optimizing over a simplex, hypercube or sphere: a short survey journal December 2007
Semidefinite programming relaxations for semialgebraic problems journal May 2003
An accelerated central cutting plane algorithm for linear semi-infinite programming journal July 2004
FPTAS for optimizing polynomials over the mixed-integer points of polytopes in fixed dimension journal September 2007
An empirical evaluation of walk-and-round heuristics for mixed integer linear programs journal February 2013
Semi-infinite programming journal July 2007
Multivariate distributions and the moment problem journal January 2013
A PTAS for the minimization of polynomials of fixed degree over the simplex journal September 2006
A cutting-plane method for quadratic semi infinite programming problems journal January 1988
Sums of Squares and Semidefinite Program Relaxations for Polynomial Optimization Problems with Structured Sparsity journal January 2006
A Central Cutting Plane Algorithm for Convex Semi-Infinite Programming Problems journal November 1993
Generating Moment Matching Scenarios Using Optimization Techniques journal January 2013
A Two-Variable Approach to the Two-Trust-Region Subproblem journal January 2016
New Douglas--Rachford Algorithmic Structures and Their Convergence Analyses journal January 2016
Solving Generalized CDT Problems via Two-Parameter Eigenvalues journal January 2016
A Note on Polynomial Solvability of the CDT Problem journal January 2016
On the von Neumann and Frank--Wolfe Algorithms with Away Steps journal January 2016
Hit-and-Run from a Corner journal January 2006
GloptiPoly: Global optimization over polynomials with Matlab and SeDuMi journal June 2003
Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion journal August 2010
Random Walks on Polytopes and an Affine Interior Point Method for Linear Programming journal February 2012
Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems journal June 2010

Cited By (5)

Robust unit commitment with $$n-1$$ n - 1 security criteria journal February 2016
Data-Driven Stochastic Programming Using Phi-Divergences book September 2015
An inexact primal-dual algorithm for semi-infinite programming journal January 2020
Scenario reduction for stochastic programs with Conditional Value-at-Risk journal May 2018
Quantitative stability analysis for minimax distributionally robust risk optimization journal November 2018