Nu-Support Vector Machine as Conditional Value-at-Risk Minimization
Description
The nu-support vector classification (nu-SVC) algorithm was shown to work well and provide intuitive interpretations, e.g., the parameter nu roughly specifies the fraction of support vectors. Although nu corresponds to a fraction, it cannot take the entire range between 0 and 1 in its original form. This problem was settled by a non-convex extension of nu-SVC and the extended method was experimentally shown to generalize better than original nu-SVC. However, its good generalization performance and convergence properties of the optimization algorithm have not been studied yet. In this paper, we provide new theoretical insights into these issues and propose a novel nu-SVC algorithm that has guaranteed generalization performance and convergence properties
| Slides | |
| 0:00 | ν-Support Vector Machine as Conditional Value-at-Risk Minimization |
| 0:21 | Binary Classification Problem |
| 1:13 | C-SVC (C-Support Vvector Classification) |
| 1:50 | ν-SVC |
| 2:28 | Admissible Values of ν |
| 3:37 | Parameter ν (Diagnosis of Diabetes) |
| 4:24 | Extended ν-SVC (Eν-SVC) |
| 5:22 | Two Open Issues |
| 5:37 | Outline: New Interpretation of Eν-SVC - 1 |
| 6:08 | Risk Score |
| 7:01 | How to Find (w,b) of the Hyperplane? |
| 8:17 | CVaR Minimization |
| 9:08 | New Interpretation of Eν-SVC |
| 10:38 | Convex / Nonconvex Program |
| 11:23 | Outline: New Interpretation of Eν-SVC - 2 |
| 11:36 | Generalization Error Bounds |
| 12:40 | Generalization Error Bounds: Case 1 |
| 13:27 | Generalization Error Bound: Cases 2&3 |
| 14:44 | Outline: A New Efficient Optimization Procedure for Eν-SVC |
| 15:00 | 2-Step Algorithm for Eν-SVC |
| 15:54 | Local Optimization Algorithm |
| 17:26 | Properties of Local Optimization Algorithm |
| 18:00 | Cutting Planes for Global Optimization |
| 19:23 | Liver-Disorders (UCI Dataset) |
| 20:48 | Conclusion |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




