Active Learning

author: John Langford, Yahoo! Research
author: Sanjoy Dasgupta, Department of Computer Science and Engineering, UC San Diego
published: Aug. 26, 2009,   recorded: June 2009,   views: 3553
Categories
You might be experiencing some problems with Your Video player.

Slides

Slides
0:00 A tutorial on active learning
0:22 Exploiting unlabeled data (1)
1:48 Exploiting unlabeled data (2)
1:58 Exploiting unlabeled data (3)
2:20 Exploiting unlabeled data (4)
4:02 Active learning example: drug design [Warmuth et al 03]
6:14 Active learning example: pedestrian detection [Freund et al 03]
8:06 Typical heuristics for active learning (1)
13:22 Sampling bias (1)
16:42 Sampling bias (2)
17:46 Sampling bias (3)
18:38 Can adaptive querying really help?
20:21 Sampling bias (3)
24:38 Can adaptive querying really help?
25:30 Case I: Exploiting cluster structure in data (1)
26:10 Case I: Exploiting cluster structure in data (2)
27:06 Case II: Efficient search through hypothesis space (1)
28:58 Case II: Efficient search through hypothesis space (2)
30:14 Outline of tutorial
30:54 A cluster-based active learning scheme [ZGL 03] (1)
31:54 A cluster-based active learning scheme [ZGL 03] (2)
32:06 A cluster-based active learning scheme [ZGL 03] (3)
32:42 A cluster-based active learning scheme [ZGL 03] (4)
33:30 A cluster-based active learning scheme [ZGL 03] (5)
34:50 Exploiting cluster structure in data [DH 08] (1)
35:10 Exploiting cluster structure in data [DH 08] (2)
35:18 Finding the right granularity (1)
35:22 Finding the right granularity (2)
35:26 Finding the right granularity (3)
35:58 Finding the right granularity (5)
35:58 Finding the right granularity (4)
36:10 Using a hierarchical clustering
37:54 Outline of tutorial
38:30 Efficient search through hypothesis space (1)
39:38 Efficient search through hypothesis space (2)
40:34 Efficient search through hypothesis space (3)
41:14 Efficient search through hypothesis space (4)
42:19 Some results of active learning theory (1)
43:38 Some results of active learning theory (2)
44:26 A generic mellow learner [CAL ’91] (1)
46:38 A generic mellow learner [CAL ’91] (2)
46:54 A generic mellow learner [CAL ’91] (3)
47:26 A generic mellow learner [CAL ’91] (4)
47:55 Maintaining Ht (1)
49:26 Maintaining Ht (2)
49:50 Label complexity [Hanneke] (1)
50:59 Label complexity [Hanneke] (2)
51:38 Label complexity [Hanneke] (3)
52:26 Label complexity [Hanneke] (4)
53:12 Maintaining Ht (2)
53:43 Label complexity [Hanneke] (4)
55:34 Disagreement coefficient [Hanneke]
60:10 Disagreement coefficient: separable case (1)
61:33 Disagreement coefficient: separable case (2)
64:30 Disagreement coefficient: examples [H ’07, F ’09] (1)
64:32 Disagreement coefficient: examples [H ’07, F ’09] (2)
64:58 Disagreement coefficient: examples [H ’07, F ’09] (3)
65:26 Disagreement coefficient: examples [H ’07, F ’09] (4)

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
 
    Delicious Bibliography

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:06:36
!NOW PLAYING
Watch Part 2
Part 2 59:34

Description

Active learning is defined by contrast to the passive model of supervised learning where all the labels for learning are obtained without reference to the learning algorithm, while in active learning the learner interactively chooses which data points to label. The hope of active learning is that interaction can substantially reduce the number of labels required, making solving problems via machine learning more practical. This hope is known to be valid in certain special cases, both empirically and theoretically.

Variants of active learning have been investigated over several decades and fields. The focus of this tutorial is on general techniques which are applicable to many problems. At a mathematical level, this corresponds to approaches with provable guarantees under weakest-possible assumptions since real problems are more likely to fit algorithms which work under weak assumptions.

We believe this tutorial should be of broad interest. People working on or using supervised learning are often confronted with the need for more labels, where active learning can help. Similarly, in reinforcement learning, generalizing while interacting in more complex ways is an active research topic. Please join us.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Javier, June 11, 2010 at 1:01 p.m.:

Where is the second part of this tutorial?

Write your own review or comment:

make sure you have javascript enabled or clear this field: