event thumbnail image
Machine Learning Summer School on Theory and Practice of Computational Learning

Generative Models for Image Analysis

author: Stuart Geman, Division of Applied Mathematics, Brown University

Description

A probabilistic grammar for the grouping and labeling of parts and objects, when taken together with pose and part-dependent appearance models, constitutes a generative scene model and a Bayesian framework for image analysis. To the extent that the generative model generates features, as opposed to pixel intensities, the inverse or posterior distribution on interpretations given images is based on incomplete information; feature vectors are generally insufficient to recover the original intensities. I will argue for fully generative scene models, meaning models that in principle generate actual digital pictures. I will outline an approach to the construction of fully generative models through an extension of context-sensitive grammars and a re-formulation of the popular template models for image fragments. Mostly I will focus on the problem of learning template models from image data. Since the model is fully specified (generative), at the pixel level, the templates can be learned by maximum likelihood. A training set of eyes, for example, yields an ensemble of left and right eyes, of familiar and natural character, but not actually coming from any particular individuals in the training set. The upshot is a mixture distribution on image patches, consisting of a set of templates and a set of conditional patch distributions - one for each template. One way to test the model is to examine samples. I will show how to sample from the mixture distribution and I will show sample sets of eyes, mouths, and generic background. Another way to test the model is to use it for detection, recognition, or classification. I will show the results of a test on ethnic classification based on the eye region of faces.

You might be experiencing some problems with Your Video player.
Slides
0:00 Generative Models for Image Analysis
0:44 Bayesian (generative) image models Feature distributions and data distributions Conditional modeling Sampling and the choice of null distribution Other applications of conditional modeling
3:26 I. Bayesian (generative) image models
7:10 II. Feature distributions and data distributions
10:24 e.g. detection and recognition of eyes
12:00 Use maximum likelihood…but what is the likelihood?
15:55 III. Conditional modeling
17:27 Conditional modeling: a perturbation of the null distribution
18:50 Estimation
20:18 Example: learning eye templates (1)
22:04 Example: learning eye templates (2)
23:01 Example: learning eye templates (3)
23:05 Example: learning eye templates (2)
23:13 Example: learning eye templates (3)
24:19 Example: learning eye templates (4)
24:44 Example: learning (right) eye templates (1)
25:37 Example: learning (right) eye templates (2)
26:33 How good are the templates? A classification experiment… (1)
28:04 How good are the templates? A classification experiment… (2)
30:09 Other examples: noses 16 templates multiple scales, shifts, and rotations
30:22 How good are the templates? A classification experiment… (2)
31:07 Other examples: noses 16 templates multiple scales, shifts, and rotations
31:28 Other examples: mixture of noses and mouths
32:03 Other examples: train on 58 faces …half with glasses…half without (1)
33:05 Other examples: train on 58 faces …half with glasses…half without (2)
34:17 Other examples: train random patches (“sparse representation”)
34:42 Other examples: train on 58 faces …half with glasses…half without (2)
35:26 Other examples: train random patches (“sparse representation”)
37:00 Other examples: coarse representation
39:13 IV. Sampling and the choice of null distribution
41:47 (approximate) sampling… (1)
42:40 (approximate) sampling… (2)
43:14 (approximate) sampling… (3)
44:20 (approximate) sampling… (4)
44:30 (approximate) sampling… (5)
45:23 V. Other applications of conditional modeling
47:24 2. Gibbs sampling
49:35 3. Hierarchical models and the Markov Dilemma
54:16 Hierarchical models and the Markov Dilemma (1)
56:53 Hierarchical models and the Markov Dilemma (2)
56:58 Hierarchical models and the Markov Dilemma (3)
57:41 PATTERN SYNTHESIS = PATTERN ANALYSIS, Ulf Grenander

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: