A primal–dual algorithm for risk minimization

Kouri, Drew P.; Surowiec, Thomas M.

doi:10.1007/s10107-020-01608-9

Title: A primal–dual algorithm for risk minimization

Journal Article · Fri Feb 05 00:00:00 EST 2021 · Mathematical Programming

DOI:https://doi.org/10.1007/s10107-020-01608-9· OSTI ID:1765742

^[1];

^[2]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Philipps-Univ. Marburg (Germany)

In this paper, we develop an algorithm to efficiently solve risk-averse optimization problems posed in reflexive Banach space. Such problems often arise in many practical applications as, e.g., optimization problems constrained by partial differential equations with uncertain inputs. Unfortunately, for many popular risk models including the coherent risk measures, the resulting risk-averse objective function is nonsmooth. Here, this lack of differentiability complicates the numerical approximation of the objective function as well as the numerical solution of the optimization problem. To address these challenges, we propose a primal–dual algorithm for solving large-scale nonsmooth risk-averse optimization problems. This algorithm is motivated by the classical method of multipliers and by epigraphical regularization of risk measures. As a result, the algorithm solves a sequence of smooth optimization problems using derivative-based methods. We prove convergence of the algorithm even when the subproblems are solved inexactly and conclude with numerical examples demonstrating the efficiency of our method.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program; Defense Advanced Research Projects Agency (DARPA); US Air Force Office of Scientific Research (AFOSR); German Research Foundation (DFG)

Grant/Contract Number:: AC04-94AL85000; NA0003525; 014150709; F4FGA09135G001; SU-963/1-1

OSTI ID:: 1765742

Report Number(s):: SAND-2021-0818J; 693611

Journal Information:: Mathematical Programming, Vol. 193, Issue 1; ISSN 0025-5610

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

References (28)

Acceleration of Stochastic Approximation by Averaging Polyak, B. T.; Juditsky, A. B. SIAM Journal on Control and Optimization, Vol. 30, Issue 4 https://doi.org/10.1137/0330046	journal	July 1992
Newton's Method for Large Bound-Constrained Optimization Problems Lin, Chih-Jen; Moré, Jorge J. SIAM Journal on Optimization, Vol. 9, Issue 4 https://doi.org/10.1137/S1052623498345075	journal	January 1999
A Version of the Bundle Idea for Minimizing a Nonsmooth Function: Conceptual Idea, Convergence Analysis, Numerical Results Schramm, Helga; Zowe, Jochem SIAM Journal on Optimization, Vol. 2, Issue 1 https://doi.org/10.1137/0802008	journal	February 1992
An Old-New Concept of Convex risk Measures: the Optimized Certainty Equivalent Ben-Tal, Aharon; Teboulle, Marc Mathematical Finance, Vol. 17, Issue 3 https://doi.org/10.1111/j.1467-9965.2007.00311.x	journal	July 2007
Epi-Regularization of Risk Measures Kouri, Drew P.; Surowiec, Thomas M. Mathematics of Operations Research, Vol. 45, Issue 2 https://doi.org/10.1287/moor.2019.1013	journal	May 2020
Validation analysis of mirror descent stochastic approximation method Lan, Guanghui; Nemirovski, Arkadi; Shapiro, Alexander Mathematical Programming, Vol. 134, Issue 2 https://doi.org/10.1007/s10107-011-0442-6	journal	February 2011
Monotone Operators and the Proximal Point Algorithm Rockafellar, R. Tyrrell SIAM Journal on Control and Optimization, Vol. 14, Issue 5 https://doi.org/10.1137/0314056	journal	August 1976
Scenarios and Policy Aggregation in Optimization Under Uncertainty Rockafellar, R. T.; Wets, Roger J. -B. Mathematics of Operations Research, Vol. 16, Issue 1 https://doi.org/10.1287/moor.16.1.119	journal	February 1991
Nonlinear stochastic programming by Monte-Carlo estimators Sakalauskas, Leonidas L. European Journal of Operational Research, Vol. 137, Issue 3 https://doi.org/10.1016/S0377-2217(01)00109-6	journal	March 2002
Multistep stochastic mirror descent for risk-averse convex stochastic programs based on extended polyhedral risk measures Guigues, Vincent Mathematical Programming, Vol. 163, Issue 1-2 https://doi.org/10.1007/s10107-016-1060-0	journal	August 2016
Risk-Averse PDE-Constrained Optimization Using the Conditional Value-At-Risk Kouri, D. P.; Surowiec, T. M. SIAM Journal on Optimization, Vol. 26, Issue 1 https://doi.org/10.1137/140954556	journal	January 2016
Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods Nedić, Angelia; Ozdaglar, Asuman SIAM Journal on Optimization, Vol. 19, Issue 4 https://doi.org/10.1137/070708111	journal	January 2009
A Multilevel Stochastic Collocation Algorithm for Optimization of PDEs with Uncertain Coefficients Kouri, D. P. SIAM/ASA Journal on Uncertainty Quantification, Vol. 2, Issue 1 https://doi.org/10.1137/130915960	journal	January 2014
Higher moment coherent risk measures Krokhmal, Pavlo A. Quantitative Finance, Vol. 7, Issue 4 https://doi.org/10.1080/14697680701458307	journal	August 2007
Inexact Objective Function Evaluations in a Trust-Region Algorithm for PDE-Constrained Optimization under Uncertainty Kouri, D. P.; Heinkenschloss, M.; Ridzal, D. SIAM Journal on Scientific Computing, Vol. 36, Issue 6 https://doi.org/10.1137/140955665	journal	January 2014
Coherent Measures of Risk Artzner, Philippe; Delbaen, Freddy; Eber, Jean-Marc Mathematical Finance, Vol. 9, Issue 3 https://doi.org/10.1111/1467-9965.00068	journal	July 1999
Robust Stochastic Approximation Approach to Stochastic Programming Nemirovski, A.; Juditsky, A.; Lan, G. SIAM Journal on Optimization, Vol. 19, Issue 4 https://doi.org/10.1137/070704277	journal	January 2009
A Trust-Region Algorithm with Adaptive Stochastic Collocation for PDE Optimization under Uncertainty Kouri, D. P.; Heinkenschloss, M.; Ridzal, D. SIAM Journal on Scientific Computing, Vol. 35, Issue 4 https://doi.org/10.1137/120892362	journal	January 2013
stochastic quasigradient methods and their application to system optimization ^† Ermoliev, Yuri Stochastics, Vol. 9, Issue 1-2 https://doi.org/10.1080/17442508308833246	journal	January 1983
On general minimax theorems Sion, Maurice Pacific Journal of Mathematics, Vol. 8, Issue 1 https://doi.org/10.2140/pjm.1958.8.171	journal	January 1958
Sampling-Based Decomposition Methods for Multistage Stochastic Programs Based on Extended Polyhedral Risk Measures Guigues, Vincent; Römisch, Werner SIAM Journal on Optimization, Vol. 22, Issue 2 https://doi.org/10.1137/100811696	journal	January 2012
On the maximal monotonicity of subdifferential mappings Rockafellar, Ralph Pacific Journal of Mathematics, Vol. 33, Issue 1 https://doi.org/10.2140/pjm.1970.33.209	journal	January 1970
Multiplier and gradient methods Hestenes, Magnus R. Journal of Optimization Theory and Applications, Vol. 4, Issue 5 https://doi.org/10.1007/BF00927673	journal	November 1969
Existence and Optimality Conditions for Risk-Averse PDE-Constrained Optimization Kouri, D. P.; Surowiec, T. M. SIAM/ASA Journal on Uncertainty Quantification, Vol. 6, Issue 2 https://doi.org/10.1137/16M1086613	journal	January 2018
Polyhedral Risk Measures in Stochastic Programming Eichhorn, Andreas; Römisch, Werner SIAM Journal on Optimization, Vol. 16, Issue 1 https://doi.org/10.1137/040605217	journal	January 2005
Dual characterization of properties of risk measures on Orlicz hearts Cheridito, Patrick; Li, Tianhui Mathematics and Financial Economics, Vol. 2, Issue 1 https://doi.org/10.1007/s11579-008-0013-7	journal	July 2008
Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming Rockafellar, R. T. Mathematics of Operations Research, Vol. 1, Issue 2 https://doi.org/10.1287/moor.1.2.97	journal	May 1976
Path-following Methods for a Class of Constrained Minimization Problems in Function Space Hintermüller, Michael; Kunisch, Karl SIAM Journal on Optimization, Vol. 17, Issue 1 https://doi.org/10.1137/040611598	journal	January 2006

Similar Records

Epi-Regularization of Risk Measures

Journal Article · Fri Aug 16 00:00:00 EDT 2019 · Mathematics of Operations Research · OSTI ID:1765742

Kouri, Drew P.; Surowiec, Thomas M.

A globally convergent LCL method for nonlinear optimization.

Journal Article · Sat Jan 01 00:00:00 EST 2005 · SIAM J. Optimization · OSTI ID:1765742

Friedlander, M P; Saunders, M A

ALESQP: An Augmented Lagrangian Equality-Constrained SQP Method for Optimization with General Constraints

Journal Article · Tue Nov 21 00:00:00 EST 2023 · SIAM Journal on Optimization · OSTI ID:1765742

Antil, Harbir; Kouri, Drew Philip; Ridzal, Denis

Related Subjects

97 MATHEMATICS AND COMPUTING
risk-averse optimization
coherent risk measures
stochastic optimization
method of multipliers

Title: A primal–dual algorithm for risk minimization

Citation Formats

References (28)

Similar Records

Related Subjects