event thumbnail image
The 25th International Conference on Machine Learning (ICML 2008)

Efficient Projections onto the L1-Ball for Learning in High Dimensions

author: Yoram Singer, Hebrew University of Jerusalem

Description

We describe efficient algorithms for projecting a vector onto the L1-ball. We present two methods for projection. The first performs exact projection in O(n) time, where n is the dimension of the space. The second works on vectors k of whose elements are perturbed outside the L1-ball, projecting in O(k log(n)) time. This setting is especially useful for online learning in sparse feature spaces such as text categorization applications. We demonstrate the merits and effectiveness of our algorithms in numerous batch and online learning tasks. We show that variants of stochastic gradient projection methods augmented with our efficient projection procedures outperform state-of-the-art optimization techniques such as interior point methods. We also show that in online settings gradient updates with L1 projections outperform the EG algorithm while obtaining models with high degrees of sparsity.

You might be experiencing some problems with Your Video player.
Slides
0:00 Efficient Projections onto the L1 Ball for Learning in High Dimensions
0:14 Feature Selection & Learning - 1
0:48 Feature Selection & Learning - 2
1:01 Feature Selection & Learning - 3
1:02 Feature Selection & Learning - 4
1:17 Feature Selection & Learning - 5
1:30 L1 Domain Constraints - 1
1:36 L1 Domain Constraints - 2
1:57 L1 Domain Constraints - 3
2:02 L1 Domain Constraints - 4
2:18 L1 Domain Constraints - 5
2:29 L1 Domain Constraints - 5
3:14 Stoc. Grad. & Domain Constraints - 1
3:20 Stoc. Grad. & Domain Constraints - 2
3:22 Stoc. Grad. & Domain Constraints - 3
3:57 Gradient Projection with L1 - 1
3:57 Gradient Projection with L1 - 2
4:07 Gradient Projection with L1 - 3
4:13 Gradient Projection with L1 - 4
4:26 Gradient Projection with L1 - 5
4:44 Projection onto L1 Ball - 1
5:03 Projection onto L1 Ball - 2
5:15 Projection onto L1 Ball - 3
5:21 Projection onto L1 Ball - 4
5:32 Projection onto L1 Ball - 5
5:49 Projection onto L1 Ball - 6
6:01 Projection onto L1 Ball - 7
6:10 Projection onto L1 Ball - 8
6:18 Projection onto L1 Ball - 9
6:38 Projection onto L1 Ball - 10
7:00 Projection onto L1 Ball - 11
7:15 Algebraic-Geometric View - 1
7:34 Algebraic-Geometric View - 2
7:41 Algebraic-Geometric View - 3

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 jk, August 30, 2008 at 5:57 p.m.:

Why is not the whole video available?
(video stops much before the talk finishes)

Write your own review or comment: