Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Distributionally Robust Decision Making Leveraging Conditional Distributions

Conference · · 2022 IEEE 61st Conference on Decision and Control (CDC)
 [1];  [2];  [2]
  1. Nvidia Corporation,Santa Clara,CA,95051; Columbia University
  2. Columbia University,New York,NY,10027
Distributionally robust optimization (DRO) is a powerful tool for decision making under uncertainty. It is particularly appealing because of its ability to leverage existing data. However, many practical problems call for decision-making with some auxiliary information, and DRO in the context of conditional distributions is not straightforward. We propose a conditional kernel distributionally robust optimization (CKDRO) method that enables robust decision making under conditional distributions through kernel DRO and the conditional mean operator in the reproducing kernel Hilbert space (RKHS). In particular, we consider problems where there is a correlation between the unknown variable y and an auxiliary observable variable x. Given past data of the two variables and a queried auxiliary variable, CKDRO represents the conditional distribution P(y|x) as the conditional mean operator in the RKHS space and quantifies the ambiguity set in the RKHS as well, which depends on the size of the dataset as well as the query point. To justify the use of RKHS, we demonstrate that the ambiguity set defined in RKHS can be viewed as a ball under a metric that is similar to the Wasserstein metric. The DRO is then dualized and solved via a finite dimensional convex program. The proposed CKDRO approach is applied to a generation scheduling problem and shows that the result of CKDRO is superior to common benchmarks in terms of quality and robustness.
Research Organization:
Columbia University
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE)
DOE Contract Number:
EE0008769
OSTI ID:
1989810
Conference Information:
Journal Name: 2022 IEEE 61st Conference on Decision and Control (CDC)
Country of Publication:
United States
Language:
English

References (20)

An Introduction to Matrix Concentration Inequalities book January 2015
From Predictive to Prescriptive Analytics journal March 2020
Optimization of Convex Risk Functions journal August 2006
Modelling of uncertain reactive human driving behavior: a classification approach conference December 2018
Data-Driven Distributionally Robust MPC for Constrained Stochastic Systems journal January 2022
Two-Stage Distributionally Robust Optimization for Energy Hub Systems journal May 2020
Data-Driven Stochastic Programming Using Phi-Divergences book September 2015
An ERCOT test system for market design studies journal October 2020
Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations journal July 2017
On the Kantorovich–Rubinstein theorem journal January 2011
On the rate of convergence in Wasserstein distance of the empirical measure journal October 2014
Robust Optimization book December 2009
Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems journal June 2010
Optimal power flow for distribution systems under uncertain forecasts conference December 2016
Chance Constrained Programming for Optimal Power Flow Under Uncertainty journal November 2011
Wasserstein Distributionally Robust Stochastic Control: A Data-Driven Approach journal August 2021
Ambiguous Risk Measures and Optimal Robust Portfolios journal January 2007
Stochastic Programming Models: Wait-and-See Versus Here-and-Now book January 2002
Two-stage distributionally robust coordinated scheduling for gas-electricity integrated energy system considering wind power uncertainty and reserve capacity configuration journal May 2019
Hilbert space embeddings of conditional distributions with applications to dynamical systems conference January 2009

Similar Records

Revealing Decision Conservativeness Through Inverse Distributionally Robust Optimization
Journal Article · Thu May 30 00:00:00 EDT 2024 · IEEE Control Systems Letters · OSTI ID:2376667

Residuals-based distributionally robust optimization with covariate information
Technical Report · Tue May 03 00:00:00 EDT 2022 · OSTI ID:2377330

Residuals-based distributionally robust optimization with covariate information
Journal Article · Mon Sep 25 20:00:00 EDT 2023 · Mathematical Programming · OSTI ID:2426805

Related Subjects