event thumbnail image
Machine Learning Summer School on Theory and Practice of Computational Learning

Statistical Classification and Cluster Processes

author: Peter McCullagh, Department of Statistics, University of Chicago

Description

After an introduction to the notion of an exchangeable random partition, we continue with a more detailed discussion of the Ewens process and some of its antecedents. The concept of an exchangeable cluster process will be described, the main example being the Gauss-Ewens process. Some applications of cluster processes will be discussed, including problems of classification or supervised learning, and cluster analysis (unsupervised learning). A second type of probabilistic model based on point processes is also described. By contrast, which the Gauss-Ewes cluster process, the domain associated with each class is more diffuse and not localized in the feature space. For both models, the classification problem is interpreted as the problem of computing the predictive distribution for the class of a new object having a given feature vector. In one case, this is a conditional distribution given the observed features, in the other a Papangelou conditional intensity.

You might be experiencing some problems with Your Video player.
Slides
0:00 Probabilistic classification models
0:36 Outline
1:27 Statistical classification and discrimination
5:08 Partitions
7:50 The set En of partitions of [n]
11:04 Probability distributions on partitions
12:51 Exchangeable partition process
14:01 The Ewens partition process
18:04 Other interpertations of the Ewens process
20:58 Characterization of the Ewens distribution
21:54 The Gauss-Ewens cluster process
24:30 Exchangeability of cluster process
24:37 Constructive version of Gauss-Ewens process
24:47 The Gauss-Ewens cluster process
24:53 Constructive version of Gauss-Ewens process
26:15 Ordinary Gauss-Ewens process in R2
28:30 Gauss-Ewens process with sub-clusters in R2
28:45 Constructive version of Gauss-Ewens process
28:50 The Gauss-Ewens cluster process
29:21 Gauss-Ewens process with sub-clusters in R2
31:09 Gauss-Ewens process with topological clusters
31:28 Cluster models for classification w/o classes
32:36 Explicit calculation of conditional distribution
34:52 Block having maximum conditional probability
36:08 A point process model for classification
38:47 Point process distributions: outline for general X
40:46 α -permanent: definition and properties
42:38 Boson point process
43:34 Boson multi-class model
44:13 Classification distributions: labelled and unlabelled
45:16 Example
46:40 Density plot of predictive probability pr(red | data)
48:34 Algorithms for approximation
49:43 References (1)
49:47 References (2)
49:48 References (3)

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: