event thumbnail image
Machine Learning Summer School 2006 - Taipei
Pascal

AdaBoost is Universally Consistent

author: Peter L. Bartlett, Berkley University

Description

We consider the risk, or probability of error, of the classifier produced by AdaBoost, and in particular the stopping strategy to be used to ensure universal consistency. (A classification method is universally consistent if the risk of the classifiers it produces approaches the Bayes risk---the minimal risk---as the sample size grows.) Several related algorithms---regularized versions of AdaBoost---have been shown to be universally consistent, but AdaBoost's universal consistency has not been established. Jiang has demonstrated that, for each probability distribution satisfying certain smoothness conditions, there is a stopping time for sample size n, so that if AdaBoost is stopped after iterations, its risk approaches the Bayes risk for that distribution. Our main result is that if AdaBoost is stopped after iterations, it is universally consistent, where n is the sample size and .

You might be experiencing some problems with Your Video player.
Slides
0:00 AdaBoost is Universally Consistent
0:30 AdaBoost
1:55 Universal Consistency
3:26 AdaBoost is Universally Consistent
4:24 Previous results: Regularized versions
6:06 Previous results: Regularized versions 01
8:05 Previous results: Bounded step size
9:05 Previous results about AdaBoost
10:05 Previous result about AdaBoost: ‘Process consistency’
12:19 AdaBoost is Universally Consistent
12:26 The key theorem
14:21 The key theorem 01
15:55 The key theorem: Idea of proof
19:33 The key theorem: Idea of proof 01
20:05 The key theorem: Idea of proof 02
20:30 The key theorem: Idea of proof 03
21:30 The key theorem: Idea of proof 04
22:36 Open Problems
25:01 AdaBoost is Universally Consistent

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: