event thumbnail image
ICML 2007 - The 24th Annual International Conference on Machine Learning

Hierarchical Maximum Entropy Density Estimation

author: Miroslav Dudík, Princeton University

Description

We study the problem of simultaneously estimating several densities where the datasets are organized into overlapping groups, such as a hierarchy. For this problem, we propose a maximum entropy formulation, which systematically incorporates the groups and allows us to share the strength of prediction across similar datasets. We derive general performance guarantees, and show how some previous approaches, such as hierarchical shrinkage and hierarchical priors, can be derived as special cases. We demonstrate the proposed technique on synthetic data and in a realworld application to modeling the geographic distributions of species hierarchically grouped in a taxonomy. Specifically, we model the geographic distributions of species in the Australian wet tropics and Northeast New South Wales. In these regions, small numbers of samples per species significantly hinder effective prediction. Substantial benefits are obtained by combining information across taxonomic groups.

You might be experiencing some problems with Your Video player.
Slides
0:00 Hierarchical Maximum Entropy Density Estimation
0:13 Modeling distributions of species - 1
1:17 Modeling distributions of species - 2
1:31 Species hierarchies
1:55 Our approach
2:38 Main results
3:14 Multiple-density estimation
4:21 Hierarchical maximum entropy
7:17 Hierarchical maximum entropy: Duality
8:28 Bayesian interpretation
9:13 Performance guarantees
11:39 HME: A toy experiment - 1
12:17 HME: A toy experiment - 2
13:25 Real-world data experiments - 1
13:56 Real-world data experiments - 2
15:04 Summary
15:34 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: