Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Progressive mixture rules are deviation suboptimal Jean-Yves Audibert

Summary: Progressive mixture rules are deviation suboptimal
Jean-Yves Audibert
Willow Project - Certis Lab
ParisTech, Ecole des Ponts
77455 Marne-la-Vall´ee, France
We consider the learning task consisting in predicting as well as the best function
in a finite reference set G up to the smallest possible additive term. If R(g) denotes
the generalization error of a prediction function g, under reasonable assumptions
on the loss function (typically satisfied by the least square loss when the output is
bounded), it is known that the progressive mixture rule ^g satisfies
ER(^g) mingG R(g) + Cst log |G|
n , (1)
where n denotes the size of the training set, and E denotes the expectation w.r.t.
the training set distribution.This work shows that, surprisingly, for appropriate
reference sets G, the deviation convergence rate of the progressive mixture rule is
no better than Cst /

n: it fails to achieve the expected Cst /n. We also provide


Source: Audibert, Jean-Yves - Département d'Informatique, École Normale Supérieure


Collections: Computer Technologies and Information Sciences