event thumbnail image
ICML 2007 - The 24th Annual International Conference on Machine Learning

Manifold-adaptive dimension estimation

author: Amir massoud Farahmand, University of Alberta

Description

Intuitively, learning should be easier when the data points lie on a low-dimensional submanifold of the input space. Recently there has been a growing interest in algorithms that aim to exploit such geometrical properties of the data. Oftentimes these algorithms require estimating the dimension of the manifold first. In this paper we propose an algorithm for dimension estimation and study its finite-sample behaviour. The algorithm estimates the dimension locally around the data points using nearest neighbor techniques and then combines these local estimates. We show that the rate of convergence of the resulting estimate is independent of the dimension of the input space and hence the algorithm is "manifold-adaptive". Thus, when the manifold supporting the data is low dimensional, the algorithm can be exponentially more efficient than its counterparts that are not exploiting this property. Our computer experiments confirm the obtained theoretical results.

You might be experiencing some problems with Your Video player.
Slides
0:00 Manifold-Adaptive Dimension Estimation
0:00 High-Dimensional Data Everywhere
0:35 Curse of Dimensionality
1:19 Practical Implications
2:15 Regularities of Data
4:40 Goal
5:18 Many Open Questions! Here: Dimension Estimation
5:58 Why?
6:50 New?
7:41 Our Contribution
7:57 General Idea - 1
9:22 General Idea - 2
9:48 General Idea - 3
10:15 General Idea - 4
10:50 General Idea - 5
11:32 General Idea - 6
12:10 Finite Sample Convergence Rate
12:58 Aggregation
13:43 Experiments
13:47 Varying the Manifold Dimension
14:51 Varying Embedding Space Dimension
15:17 Other Datasets
15:52 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: