Flexible Priors for Exemplar-based Clustering
Description
Exemplar-based clustering methods have been shown to produce state-of-the-art results on a number of synthetic and real-world clustering problems. They are appealing because they offer computational benefits over latent-mean models and can handle arbitrary pairwise similarity measures between data points. However, when trying to recover underlying structure in clustering problems, tailored similarity measures are often not enough; we also desire control over the distribution of cluster sizes. Priors such as Dirichlet process priors allow the number of clusters to be unspecified while expressing priors over data partitions. To our knowledge, they have not been applied to exemplar-based models. We show how to incorporate priors, including Dirichlet process priors, into the recently introduced affinity propagation algorithm. We develop an efficient max product belief propagation algorithm for our new model and demonstrate experimentally how the
expanded range of clustering priors allows us to better recover true clusterings in situations where we have some information about the generating process.
| Slides | |
| 0:00 | Flexible Priors for Exemplar-based Clustering |
| 0:29 | A Bigger Question... - 1 |
| 1:04 | A Bigger Question... - 2 |
| 1:10 | Motivating Example - 1 |
| 2:16 | Motivating Example - 2 |
| 2:33 | Motivating Example - 3 |
| 2:59 | Goal of this Work |
| 3:33 | Building Blocks |
| 3:40 | Exemplar-based Clustering |
| 4:16 | Exemplar-based Clustering (cont.) |
| 5:11 | Overview |
| 6:13 | Comparison |
| 6:48 | Exemplar-based Dirichlet Process Mixture Model |
| 7:09 | Generative Model (Notation) |
| 7:57 | Generative Model |
| 8:35 | Generative Model - 1 |
| 9:10 | Generative Model - 2 |
| 9:24 | Generative Model - 3 |
| 10:14 | Draws from 2D Gaussian Model |
| 10:59 | Max-Product (Max-Sum) Inference |
| 11:12 | Factor Graph - 1 |
| 12:34 | Representation |
| 13:19 | Max-sum Belief Propagation in Factor Graphs |
| 14:11 | Factor Graph - 2 |
| 14:38 | Key Computation - 1 |
| 15:21 | Key Computation - 2 |
| 15:59 | Remaining Computations |
| 16:08 | Experiments |
| 16:11 | Experiments - 1 |
| 16:40 | Algorithms - 1 |
| 17:00 | Synthetic Experiments - 1 |
| 17:41 | Synthetic Experiments - 2 |
| 17:51 | Synthetic Experiments - 3 |
| 18:16 | Real Experiments: Image Segmentation - 1 |
| 18:57 | Real Experiments: Image Segmentation - 2 |
| 19:11 | Algorithms - 2 |
| 19:20 | Real Experiments: Image Segmentation - 3 |
| 19:45 | Real Experiments: Image Segmentation - 4 |
| 19:47 | Conclusions and Future Work |
| 21:03 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




