Denoising and Dimension Reduction in Feature Space

author: Mikio Braun, Fraunhofer Institute for Intelligent Analysis and Information Systems
author: Klaus-Robert Müller, Department of Software Engineering and Theoretical Computer Science, Technische Universität Berlin
published: Dec. 10, 2007,   recorded: September 2007,   views: 5692


Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.


The talk presents recent work that interestingly complements our understanding the VC picture in kernel based learning. Our finding is that the relevant information of a supervised learning problem is contained up to negligible error in a finite number of leading kernel PCA components if the kernel matches the underlying learning problem. Thus, kernels not only transform data sets such that good generalization can be achieved using only linear discriminant functions, but this transformation is also performed in a manner which makes economic use of feature space dimensions. In the best case, kernels provide efficient implicit representations of the data for supervised learning problems. Practically, we propose an algorithm which enables us to recover the subspace and dimensionality relevant for good classification. Our algorithm can therefore be applied (1) to analyze the interplay of data set and kernel in a geometric fashion, (2) to aid in model selection, and to (3) denoise in feature space in order to yield better classification results. We complement our theoretical findings by reporting on applications of our method to data from gene finding and brain computer interfacing. This is joint work with Claudia Sannelli and Joachim M. Buhmann

See Also:

Download slides icon Download slides: acs07_muller_braun_ddr.pdf (1.4 MB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: