event thumbnail image
Subspace, Latent Structure and Feature Selection techniques: Statistical and Optimisation perspectives Workshop
Pascal

Random projection, margins, kernels, and feature-selection

author: Avrim Blum, Carnegie Mellon University

Description

Random projection is a simple technique that can often provide insight into questions such as "why is it good to have a large margin?" or "what are kernels really doing and how are they similar to feature selection?" In this talk I will describe some simple learning algorithms using random projection. I will then discuss how, given a kernel as a black-box function, we can use various forms of random projection to extract an explicit small feature space that captures much of the power of the given kernel function.

You might be experiencing some problems with Your Video player.
Slides
0:01 Random projection, margins, kernels, and feature-selection
1:28 Random Projection
2:19 Random Projection
3:52 Uses in approximation algorithms
5:37 Basic Supervised learning setting
6:39 Margins
9:08 JL Lemma
10:00 JL Lemma
14:02 JL Lemma, cont
15:43 Random projection and margins
18:18 Random projection and margins
19:57 Random projection and margins

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: