event thumbnail image
PASCAL Bootcamp in Machine Learning
Pascal

Learning without overlearning

author: Isabelle Guyon, Clopinet

Description

This course covers feature selection fundamentals and applications. The students will first be reminded of the basics of machine learning algorithms and the problem of overfitting avoidance. In the wrapper setting, feature selection will be introduced as a special case of the model selection problem. Methods to derive principled feature selection algorithms will be reviewed as well as heuristic method, which work well in practice. One class will be devoted to feature construction techniques. Finally, a lecture will be devoted to the connections between feature section and causal discovery. The class will be accompanied by several lab sessions. The course will be attractive to students who like playing with data and want to learn practical data analysis techniques. The instructor has ten years of experience with consulting for startup companies in the US in pattern recognition and machine learning. Datasets from a variety of application domains will be made available: handwriting recognition, medical diagnosis, drug discovery, text classification, ecology, marketing.

You might be experiencing some problems with Your Video player.
Slides
0:00 Lecture 1: Learning without Over-learning
0:48 Machine Learning
1:57 What is a Risk Functional?
3:09 Example Risk Functionals
3:42 How to Train?
4:30 Fit / Robustness Tradeoff
6:34 Overfitting
8:23 Ockham’s Razor
10:06 The Power of Amnesia
11:05 Artificial Neurons
12:21 Hebb’s Rule
13:30 Weight Decay
14:08 Overfitting Avoidance
16:05 Weight Decay for MLP
16:37 Theoretical Foundations
17:01 Risk Minimization
18:21 Loss Functions
22:42 Approximations of R[f]

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 0:24:27
Flash video Windows Media video

!NOW PLAYING
Watch Part 2
Part 2 0:31:19
Flash video Windows Media video

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: