Online Dictionary Learning for Sparse Coding

author: Julien Mairal, INRIA
published: Aug. 26, 2009,   recorded: June 2009,   views: 34723


Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.


Sparse coding—that is, modelling data vectors as sparse linear combinations of basis elements—is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on learning the basis set, also called dictionary, to adapt it to specific data, an approach that has recently proven to be very effective for signal reconstruction and classification in the audio and image processing domains. This paper proposes a new online optimization algorithm for dictionary learning, based on stochastic approximations, which scales up gracefully to large datasets with millions of training samples. A proof of convergence is presented, along with experiments with natural images demonstrating that it leads to faster performance and better dictionaries than classical batch algorithms for both small and large datasets.

See Also:

Download slides icon Download slides: icml09_mairal_odlsc_01.pdf (6.8 MB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Q. Tinh Tang, June 24, 2012 at 4:24 p.m.:

Dear Sir:

I'd like to hera the lecture of interdisciplenary especially the interactive of Computer Science and Engineering.

Hower as the analogy of analog world I had hearing a lot of training from Fellow of the mentionned above.

Any Way as We all knew its' for a posteri from the ealry players.

Write your own review or comment:

make sure you have javascript enabled or clear this field: