Estimating conditional quantiles with the help of the pinball loss
- Los Alamos National Laboratory
Using the so-called pinball loss for estimating conditional quantiles is a well-known tool in both statistics and machine learning. So far, however, only little work has been done to quantify the efficiency of this tool for non-parametric (modified) empirical risk minimization approaches. The goal of this work is to fill this gap by establishing inequalities that describe how close approximate pinball risk minimizers are to the corresponding conditional quantile. These inequalities, which hold under mild assumptions on the data-generating distribution, are then used to establish so-called variance bounds which recently turned out to play an important role in the statistical analysis of (modified) empirical risk minimization approaches. To illustrate the use of the established inequalities, we then use them to establish an oracle inequality for support vector machines that use the pinball loss. Here, it turns out that we obtain learning rates which are optimal in a min-max sense under some standard assumptions on the regularity of the conditional quantile function.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- OSTI ID:
- 962240
- Report Number(s):
- LA-UR-08-04612; LA-UR-08-4612; TRN: US0903406
- Journal Information:
- To be submitted to the journal ""Bernoulli, Journal Name: To be submitted to the journal ""Bernoulli
- Country of Publication:
- United States
- Language:
- English
Similar Records
Probabilistic Short-Term Wind Forecasting Based on Pinball Loss Optimization: Preprint
Topics in Theoretical Physics