event thumbnail image
Workshops

Information consistency of nonparametric Gaussian process methods

author: Mathias Seeger, Max Planck Institute for Biological Cybernetics

Description

We present information consistency results for nonparametric sequential prediction with Gaussian processes. The connection to nonparametric MDL is through the prequential approach, as detailed in Gruenwald's 2007 book, Sect. 13.5. Our proof technique is elementary, making use of a convex duality previously useful to obtain PAC-Bayesian bounds. We also obtain precise information consistency rates for a wide range of kernels and input distributions, using kernel eigenvalue asymptotics. In all these cases, the linear expert space is an infinite-dimensional function space, but still very reasonable rates are obtained.

You might be experiencing some problems with Your Video player.
Slides
0:00 Information Consistency of Nonparametric Gaussian
0:46 The Prediction Game (1)
1:58 The Prediction Game (2)
3:52 The Prediction Game (3)
4:18 Information Consistency (1)
5:09 Information Consistency (2)
5:59 Information Consistency (3)
6:54 Information Consistency (II) (1)
7:41 Information Consistency (II) (2)
7:56 Information Consistency (II) (3)
8:29 Information Consistency (II) (4)
9:45 Proof Idea (1)
11:07 Proof Idea (2)
12:33 Proof Idea (3)
13:10 The Regret Term (1)
14:40 The Regret Term (2)
16:29 The Regret Term (3)
17:54 The Regret Term (II) (1)
19:14 The Regret Term (II) (2)
19:36 The Regret Term (II) (3)
21:25 Information Consistency Rates (1)
22:40 Information Consistency Rates (2)
23:01 Information Consistency Rates (3)
23:50 Information Consistency Rates (4)
25:05 Information Consistency Rates (II) (1)
25:39 Information Consistency Rates (II) (2)
26:33 Information Consistency Rates (II) (3)
27:19 Information Consistency Rates (II) (4)
28:09 Conclusions (1)
28:27 Conclusions (2)
28:57 Conclusions (3)
29:19 Conclusions (4)
30:30 Conclusions (5)

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: