event thumbnail image
The 25th International Conference on Machine Learning (ICML 2008)

Nu-Support Vector Machine as Conditional Value-at-Risk Minimization

author: Akiko Takeda, Keio University

Description

The nu-support vector classification (nu-SVC) algorithm was shown to work well and provide intuitive interpretations, e.g., the parameter nu roughly specifies the fraction of support vectors. Although nu corresponds to a fraction, it cannot take the entire range between 0 and 1 in its original form. This problem was settled by a non-convex extension of nu-SVC and the extended method was experimentally shown to generalize better than original nu-SVC. However, its good generalization performance and convergence properties of the optimization algorithm have not been studied yet. In this paper, we provide new theoretical insights into these issues and propose a novel nu-SVC algorithm that has guaranteed generalization performance and convergence properties

You might be experiencing some problems with Your Video player.
Slides
0:00 ν-Support Vector Machine as Conditional Value-at-Risk Minimization
0:21 Binary Classification Problem
1:13 C-SVC (C-Support Vvector Classification)
1:50 ν-SVC
2:28 Admissible Values of ν
3:37 Parameter ν (Diagnosis of Diabetes)
4:24 Extended ν-SVC (Eν-SVC)
5:22 Two Open Issues
5:37 Outline: New Interpretation of Eν-SVC - 1
6:08 Risk Score
7:01 How to Find (w,b) of the Hyperplane?
8:17 CVaR Minimization
9:08 New Interpretation of Eν-SVC
10:38 Convex / Nonconvex Program
11:23 Outline: New Interpretation of Eν-SVC - 2
11:36 Generalization Error Bounds
12:40 Generalization Error Bounds: Case 1
13:27 Generalization Error Bound: Cases 2&3
14:44 Outline: A New Efficient Optimization Procedure for Eν-SVC
15:00 2-Step Algorithm for Eν-SVC
15:54 Local Optimization Algorithm
17:26 Properties of Local Optimization Algorithm
18:00 Cutting Planes for Global Optimization
19:23 Liver-Disorders (UCI Dataset)
20:48 Conclusion

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: