Efficient Discriminative Training Method for Structured Predictions

author: Huizhen Yu, University of Helsinki
published: Aug. 25, 2008,   recorded: July 2008,   views: 168
You might be experiencing some problems with Your Video player.

Slides

Slides
0:00 Efficient Discriminative Training Method for Structured Predictions
0:00 Two Aspects in This Research
0:43 Outline - Overview and Problem Formulation
1:09 Overview - 1
1:38 Overview - 2
2:43 Overview - 3
3:07 Setting for Supervised Learning - 1
4:02 Setting for Supervised Learning - 2
4:59 Setting for Supervised Learning - 3
5:28 Formulation of Discriminative Training Problem - 1
6:03 Formulation of Discriminative Training Problem - 2
6:46 Formulation of Discriminative Training Problem - 3
7:54 Primal Problem - 1
8:13 Primal Problem - 2
9:01 Primal Problem - 3
9:28 Outline - Algorithm
9:31 Reparametrization: Dimensionality Reduction - 1
9:58 Reparametrization: Dimensionality Reduction - 2
10:11 Reparametrization: Dimensionality Reduction - 3
10:21 Reparametrization: Dimensionality Reduction - 4
10:55 Size-Reduced Dual Problem - 1
11:46 Size-Reduced Dual Problem - 2
13:01 Background: Feasible Direction Methods: Simplicial Decomposition - 1
13:28 Background: Feasible Direction Methods: Simplicial Decomposition - 2
13:43 Background: Feasible Direction Methods: Simplicial Decomposition - 3
14:32 Restricted Simplicial Decomposition (RSD) - 1
15:05 Restricted Simplicial Decomposition (RSD) - 2
16:28 Algorithm: Reparametrization + RSD + · · · - 1
17:05 Algorithm: Reparametrization + RSD + · · · - 2
17:33 Dual Proximal Point Algorithm - 1
18:13 Dual Proximal Point Algorithm - 2
19:19 Algorithm Chart from Dual Viewpoint
20:25 Algorithm Variants with Same Idea - 1
21:34 Algorithm Variants with Same Idea - 2
22:54 Algorithm Behavior and Comparisons of Working Set Sizes
25:04 Outline - Preliminary Experiments
25:13 I: The Synthetic HMM Example
26:46 II: Yeast Dataset – a Case Study on Modeling - 1
28:23 II: Yeast Dataset – a Case Study on Modeling - 2
30:00 II: Yeast Dataset – a Case Study on Modeling - 3
32:39 II: Yeast Dataset – a Case Study on Modeling - 4
33:14 Outline - Summary
33:18 - Questions
33:19 - Questions

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
 
    Delicious Bibliography

Description

We propose an efficient discriminative training method for generative models under supervised learning. In our setting, fully observed instances are given as training examples, together with a specification of variables of interest for prediction. We formulate the training as a convex programming problem, incorporating the SVM-type large margin constraints to favor parameters under which the maximum a posteriori (MAP) estimates of the prediction variables, conditioned on the rest, are close to their true values given in the training instances. The resulting optimization problem is, however, more complex than its quadratic programming (QP) counterpart resulting from the SVM-type training of conditional models, because of the presence of non-linear constraints on the parameters. We present an efficient optimization method, which combines several techniques, namely, a data-dependent reparametrization of dual variables, restricted simplicial decomposition, and the proximal point algorithm. Our method extends the one for solving the aforementioned QP counterpart, proposed earlier by some of the authors.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: