High-dimensional Statistics: Prediction, Association and Causal Inference

author: Peter Bühlmann, ETH Zurich
published: Jan. 12, 2011,   recorded: December 2010,   views: 1798
Categories
You might be experiencing some problems with Your Video player.

Slides

Slides
0:00 High-dimensional statistics: from assocation to causal inference
0:30 Collaborators
0:43 High-dimensional data (1)
1:54 High-dimensional data (2)
4:15 High-dimensional linear models
5:40 Exemplifying the outline (1)
7:45 Exemplifying the outline (2)
8:01 However
8:18 Exemplifying the outline (2)
8:22 However
9:49 The Lasso
12:24 More about "L1-geometry"
13:16 L1-"world"
14:53 L2- "world" is different
15:15 Orthonormal design
17:45 Using the Lasso...
20:09 Theory for the Lasso: Prediction and estimation (1)
23:39 Theory for the Lasso: Prediction and estimation (2)
25:36 Choice of lambda and probability of the set T
25:40 Theory for the Lasso: Prediction and estimation (2)
25:47 Choice of lambda and probability of the set T
25:55 Theory for the Lasso: Prediction and estimation (2)
26:21 Choice of lambda and probability of the set T
26:24 Theory for the Lasso: Prediction and estimation (2)
26:29 Choice of lambda and probability of the set T
26:36 Theory for the Lasso: Prediction and estimation (2)
26:40 Choice of lambda and probability of the set T
26:58 Theory for the Lasso: Prediction and estimation (2)
27:11 Choice of lambda and probability of the set T
28:48 For prediction with high-dimensional L1-penalization
28:54 Choice of lambda and probability of the set T
28:56 Theory for the Lasso: Prediction and estimation (2)
28:59 For prediction with high-dimensional L1-penalization
29:24 No assumptions on the (fixed) design matrix
32:03 Aim
34:34 Compatibility condition
35:05 Aim
35:12 Compatibility condition
36:21 Oracle inequality
38:08 Just make the appropriate assumptions to prove what you like (1)
39:23 Just make the appropriate assumptions to prove what you like (2)
40:26 Does compatibility condition hold in practice?
43:35 Summary I (for Lasso)
44:45 Remark
45:48 Variable selection
49:09 Question
50:39 Lasso for variable selection
52:05 Motif regression
53:04 Theory for the Lasso: Part II (1)
54:23 Theory for the Lasso: Part II (2)
55:39 Theory for the Lasso: Part II (3)
56:15 Various design conditions
56:53 Not very realistic assumptions... what can we expect?
59:22 Assuming beta-min condition
59:48 LASSO
60:12 Assuming beta-min condition
60:19 LASSO
60:20 Practical perspective
62:01 Recall (1)
62:24 Recall (2)
62:58 Summary II (1)
63:54 Summary II (2)
64:56 Gaussian graphical models
67:19 Meinshausen & PB
69:35 Back to variable selection in regression
69:47 - Questions

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
 
    Delicious Bibliography

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:12:22
!NOW PLAYING
Watch Part 2
Part 2 49:51

Description

This tutorial surveys methodology and theory for high-dimensional statistical inference when the number of variables or features greatly exceeds sample size. Particular emphasis will be placed on problems of model and feature selection. This includes variable selection in regression models or estimation of the edge set in graphical modeling. While the former is concerned with association, the latter can be used for causal analysis. In the high-dimensional setting, major challenges include designing computational algorithms that are feasible for large-scale problems, assigning statistical error rates (e.g., p-values), and developing theoretical insights about the limits of what is possible. We will present some of the most important recent developments and discuss their implications for prediction, association analysis and some exciting new directions in causal inference.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: