event thumbnail image
ICML 2007 - The 24th Annual International Conference on Machine Learning

Bayesian models of human inductive learning

author: Josh Tenenbaum, MIT - Massachusetts Institute of Technology

Description

In everyday learning and reasoning, people routinely draw successful generalizations from very limited evidence. Even young children can infer the meanings of words, hidden properties of objects, or the existence of causal relations from just one or a few relevant observations -- far outstripping the capabilities of conventional learning machines. How do they do it? And how can we bring machines closer to these human-like learning abilities? I will argue that people's everyday inductive leaps can be understood as approximations to Bayesian computations operating over structured representations of the world, what cognitive scientists have called "intuitive theories" or "schemas". For each of several everyday learning tasks, I will consider how appropriate knowledge representations are structured and used, and how these representations could themselves be learned via Bayesian methods. The key challenge is to balance the need for strongly constrained inductive biases -- critical for generalization from very few examples -- with the flexibility to learn about the structure of new domains, to learn new inductive biases suitable for environments which we could not have been pre-programmed to perform in. The models I discuss will connect to several directions in contemporary machine learning, such as semi-supervised learning, structure learning in graphical models, hierarchical Bayesian modeling, and nonparametric Bayes.

You might be experiencing some problems with Your Video player.
Slides
0:00 Bayesian models of human inductive learning Josh Tenenbaum MIT Department of Brain and Cognitive Sciences Computer Science and AI Lab (CSAIL)
2:48 Lab members
3:20 The probabilistic revolution in AI
5:00 Everyday inductive leaps
6:36 Learning concepts from examples
7:45 Everyday inductive leaps
9:22 The solution
10:08 The solution01
14:10 The approach: from statistics to intelligence
16:33 Outline
17:12 The “shape bias” in word learning (Landau, Smith, Jones 1988)
18:54 Is the shape bias learned?
21:01 Transfer to real-world vocabulary
24:06 Learning about feature variability
24:52 Learning about feature variability01
25:25 A hierarchical Bayesian model
26:07 A hierarchical Bayesian model01
27:13 A hierarchical Bayesian model02
27:52 A hierarchical Bayesian model03
28:50 A hierarchical Bayesian model04
29:35 Learning the shape bias
30:23 Learning the shape bias01
31:43 Extensions
33:02 Learning to transfer selectively
34:12 Learning to transfer selectively01
36:02 Outline
36:29 Property induction
37:59 The computational problem
40:45 Hierarchical Bayesian Framework
42:22 P(D|S): How the structure constrains the data of experience
42:53 P(D|S): How the structure constrains the data of experience01
44:03 P(D|S): How the structure constrains the data of experience02
44:14 Structure S
44:57 slide34
45:10 [c.f., Lawrence, 2004; Smola & Kondor 2003]
45:40 Structure S
46:09 Cows have property P. Elephants have property P. Horses have property P.
47:29 Testing different priors
49:18 Learning about spatial properties
50:18 Hierarchical Bayesian Framework
50:44 Discovering structural forms
51:04 Discovering structural forms01
51:24 People can discover structural forms
52:52 The ultimate goal
53:20 A “universal grammar” for structural forms
54:46 Hierarchical Bayesian Framework
55:32 slide47
57:23 Structural forms from relational data
57:31 Lab studies of learning structural forms
57:36 Development of structural forms as more data are observed
60:09 Beyond “Nativism” versus “Empiricism”
61:44 Summary

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Lazar, July 30, 2007 at 7:26 a.m.:

I enjoyed every minute of this great lecture. This should be a mandatory AI educational piece, and I will recommend it to everyone who I know is interested in the subject.


Comment2 AIier, August 1, 2007 at 9:07 a.m.:

truly Amazing Lecture, highly recommended. People who like old-school AI of "structured" representation, will get to know how to do achieve that using mainstream "Statistical" approaches. Thanks Josh!


Comment3 Eugen Hotwagner, December 13, 2007 at 1:14 p.m.:

impressive lecture. coming from a psychologist background myself this was the most informative and insightful presentation of that subject i have seen. in my opinion the lack of rigor and practical orientation renders the psychological approaches useless most of the time.

Write your own review or comment:

make sure you have javascript enabled or clear this field: