AdaBoost is Universally Consistent
Description
We consider the risk, or probability of error, of the classifier produced by AdaBoost, and in particular the stopping strategy to be used to ensure universal consistency. (A classification method is universally consistent if the risk of the classifiers it produces approaches the Bayes risk---the minimal risk---as the sample size grows.) Several related algorithms---regularized versions of AdaBoost---have been shown to be universally consistent, but AdaBoost's universal consistency has not been established. Jiang has demonstrated that, for each probability distribution satisfying certain smoothness conditions, there is a stopping time for sample size n, so that if AdaBoost is stopped after iterations, its risk approaches the Bayes risk for that distribution. Our main result is that if AdaBoost is stopped after iterations, it is universally consistent, where n is the sample size and .
| Slides | |
| 0:00 | AdaBoost is Universally Consistent |
| 0:30 | AdaBoost |
| 1:55 | Universal Consistency |
| 3:26 | AdaBoost is Universally Consistent |
| 4:24 | Previous results: Regularized versions |
| 6:06 | Previous results: Regularized versions 01 |
| 8:05 | Previous results: Bounded step size |
| 9:05 | Previous results about AdaBoost |
| 10:05 | Previous result about AdaBoost: ‘Process consistency’ |
| 12:19 | AdaBoost is Universally Consistent |
| 12:26 | The key theorem |
| 14:21 | The key theorem 01 |
| 15:55 | The key theorem: Idea of proof |
| 19:33 | The key theorem: Idea of proof 01 |
| 20:05 | The key theorem: Idea of proof 02 |
| 20:30 | The key theorem: Idea of proof 03 |
| 21:30 | The key theorem: Idea of proof 04 |
| 22:36 | Open Problems |
| 25:01 | AdaBoost is Universally Consistent |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !






