Structured Output Prediction with Structural SVMs
Description
This talk explores large-margin approaches to predicting graph-based objects like trees, clusterings, or alignments. Such problems arise, for example, when a natural language parser needs to predict the correct parse tree for a given sentence, when one needs to determine the co-reference relationships of noun-phrases in a document, or when predicting the alignment between two proteins. In particular, the talk will show how structural SVMs can learn such complex prediction rules, using the problems of supervised clustering, protein sequence alignment, and diversification in search engines as application examples. Furthermore, the talk will present new cutting-plane algorithms that allows training of structural SVMs in time linear in the number of training examples.
| Slides | |
| 0:00 | Structured Output Prediction with Structural Support Vector Machines |
| 0:19 | Supervised Learning |
| 1:35 | Examples of Complex Output Spaces - 1 |
| 2:26 | Examples of Complex Output Spaces - 2 |
| 3:00 | Examples of Complex Output Spaces - 3 |
| 4:09 | Examples of Complex Output Spaces - 4 |
| 4:44 | Examples of Complex Output Spaces - 5 |
| 5:04 | Overview: Related Work |
| 6:05 | Why Discriminative Learning for Structured Outputs? |
| 7:53 | Related Work |
| 8:49 | Overview: SVM Algorithm for Complex Outputs |
| 9:00 | Classification SVM |
| 10:37 | Challenges in Discriminative Learning with Complex Outputs |
| 11:54 | Multi-Class SVM |
| 13:45 | Joint Feature Map |
| 14:54 | Joint Feature Map for Trees |
| 17:36 | Structural Support Vector Machine |
| 18:55 | Loss Functions: Soft-Margin Struct SVM |
| 20:19 | Experiment: Natural Language Parsing |
| 21:59 | Generic Structural SVM |
| 24:12 | Reformulation of the Structural SVM QP - 1 |
| 26:24 | Reformulation of the Structural SVM QP - 2 |
| 28:13 | Cutting-Plane Algorithm for Structural SVM (1-Slack Formulation) |
| 30:47 | Polynomial Sparsity Bound |
| 32:05 | Empirical Comparison: Different Formulations |
| 33:00 | Applying StructSVM to New Problem |
| 34:11 | Overview: Applications - 1 |
| 34:27 | Comparative Modeling of Protein Structure |
| 36:15 | Linear Score Sequence Alignment |
| 37:38 | Predicting an Alignment |
| 38:37 | Scoring Function for Vector Sequences |
| 39:34 | Loss Function and Separation Oracle - 1 |
| 40:53 | Experiment |
| 41:41 | Experiment Results |
| 43:38 | Overview: Applications - 2 |
| 43:53 | Diversified Retrieval |
| 45:49 | Approach |
| 48:37 | Features Describing Word Importance |
| 49:05 | Loss Function and Separation Oracle - 2 |
| 50:19 | Experiments |
| 52:08 | Overview: Applications - 3 |
| 52:12 | Learning to Cluster |
| 52:25 | Struct SVM for Supervised Clustering |
| 54:04 | Summary and Conclusions |
| 58:07 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




