Non-Isometric Manifold Learning: Analysis and an Algorithm
Description
In this work we take a novel view of nonlinear manifold learning. Usually, manifold learning is formulated in terms of finding an embedding or "unrolling" of a manifold into a lower dimensional space. Instead, we treat it as the problem of learning a representation of a nonlinear, possibly non-isometric manifold that allows for the manipulation of novel points. Central to this view of manifold learning is the concept of generalization beyond the training data. Drawing on concepts from supervised learning, we establish a framework for studying the problems of model assessment, model complexity, and model selection for manifold learning. We present an extension of a recent algorithm, Locally Smooth Manifold Learning (L S M L), and show it has good generalization properties. L S M L learns a representation of a manifold or family of related manifolds and can be used for computing geodesic distances, finding the projection of a point onto a manifold, recovering a manifold from points corrupted by noise, generating novel points on a manifold, and more.
| Slides | |
| 0:00 | Non-Isometric Manifold Learning: Analysis and an Algorithm |
| 0:23 | Motivation |
| 1:30 | Linear Manifolds (Subspaces) |
| 2:22 | Non-Linear Manifolds |
| 2:48 | Locally Smooth Manifold Learning (LSML) |
| 3:13 | Learning the Tangent Space - 1 |
| 3:34 | Learning the Tangent Space - 2 |
| 4:33 | Loss Function |
| 6:27 | Optimization Procedure |
| 7:26 | Analyzing Manifold Learning Methods |
| 7:30 | - Questions |
| 7:44 | Analyzing Manifold Learning Methods |
| 8:21 | Evaluation Metric |
| 10:52 | Finite Sample Performance |
| 11:57 | Model Complexity |
| 13:07 | LSML Test Error - 1 |
| 14:49 | LSML Test Error - 2 |
| 15:38 | Using the Tangent Space |
| 16:00 | Projection |
| 17:09 | Manifold De-Noising |
| 18:22 | Geodesic Distance - 1 |
| 18:45 | Geodesic Distance - 2 |
| 19:20 | Generalization |
| 20:27 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




