AdaBoost is Universally Consistent

author:Peter L. Bartlett, UC Berkeley, University of California
published: Feb. 25, 2007,   recorded: August 2006,   views: 425
Categories
You might be experiencing some problems with Your Video player.

Related content

Visitors who watched this lecture also watched...
32:36
The Dynamics of AdaBoost

2895 views - Cynthia Rudin, 2005
02:07:12
Boosting

3955 views - Robert Schapire, 2005
03:44:15
Introduction to Boosting

1003 views - Gunnar Rätsch, 2006
05:09:55
Pattern Classification and Large Margin Classifiers

654 views - Peter L. Bartlett, 2006
04:59:19
Machine Learning, Probability and Graphical Models

18459 views - Sam Roweis, 2006
03:54:31
Support Vector Machines

12771 views - Chih-Jen Lin, 2006
16:20
An Introduction to Ensemble and Boosting

531 views - Amir Saffari, 2007
02:57:22
Boosting

276 views - Gunnar Rätsch, 2004
05:02:23
Statistical Learning Theory

8005 views - John Shawe-Taylor, 2004
47:26
Overview of New Developments in Boosting

391 views - Joseph K. Bradley, 2008

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.

Description

We consider the risk, or probability of error, of the classifier produced by AdaBoost, and in particular the stopping strategy to be used to ensure universal consistency. (A classification method is universally consistent if the risk of the classifiers it produces approaches the Bayes risk---the minimal risk---as the sample size grows.) Several related algorithms---regularized versions of AdaBoost---have been shown to be universally consistent, but AdaBoost's universal consistency has not been established. Jiang has demonstrated that, for each probability distribution satisfying certain smoothness conditions, there is a stopping time for sample size n, so that if AdaBoost is stopped after iterations, its risk approaches the Bayes risk for that distribution. Our main result is that if AdaBoost is stopped after iterations, it is universally consistent, where n is the sample size and .

Link this page  

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: