AdaBoost is Universally Consistent
published: Feb. 25, 2007, recorded: August 2006, views: 425
Slides
Related content
32:36
2895 views - Cynthia Rudin, 2005
02:07:12
3955 views - Robert Schapire, 2005
03:44:15
1003 views - Gunnar Rätsch, 2006
05:09:55
654 views - Peter L. Bartlett, 2006
04:59:19
18459 views - Sam Roweis, 2006
03:54:31
12771 views - Chih-Jen Lin, 2006
16:20
531 views - Amir Saffari, 2007
02:57:22
276 views - Gunnar Rätsch, 2004
05:02:23
8005 views - John Shawe-Taylor, 2004
47:26
391 views - Joseph K. Bradley, 2008
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Description
We consider the risk, or probability of error, of the classifier produced by AdaBoost, and in particular the stopping strategy to be used to ensure universal consistency. (A classification method is universally consistent if the risk of the classifiers it produces approaches the Bayes risk---the minimal risk---as the sample size grows.) Several related algorithms---regularized versions of AdaBoost---have been shown to be universally consistent, but AdaBoost's universal consistency has not been established. Jiang has demonstrated that, for each probability distribution satisfying certain smoothness conditions, there is a stopping time for sample size n, so that if AdaBoost is stopped after iterations, its risk approaches the Bayes risk for that distribution. Our main result is that if AdaBoost is stopped after iterations, it is universally consistent, where n is the sample size and .
See Also:
Download slides:
mlss06tw_bartlett_auc.pdf (75.9 KB)
Launch in a standalone WM Player
Switch to Windows Media Player
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




Write your own review or comment: