Graph Transduction via Alternating Minimization
Description
Graph transduction methods label input data by learning a classification function that is regularized to exhibit smoothness along a graph over labeled and unlabeled samples. In practice, these algorithms are sensitive to the initial set of labels provided by the user. For instance, classification accuracy drops if the training set contains weak labels, if imbalances exist across label classes or if the labeled portion of the data is not chosen at random. This paper introduces a propagation algorithm that more reliably minimizes a cost function over both a function on the graph and a binary label matrix. The cost function generalizes prior work in graph transduction and also introduces node normalization terms for resilience to label imbalances. We demonstrate that global minimization of the function is intractable but instead provide an alternating minimization scheme that incrementally adjusts the function and the labels towards a reliable local minimum. Unlike prior methods, the resulting propagation of labels does not prematurely commit to an erroneous labeling and obtains more consistent labels. Experiments are shown for synthetic and real classification tasks including digit and text recognition. A substantial improvement in accuracy compared to state of the art semi-supervised methods is achieved. The advantage are even more dramatic when labeled instances are limited.
| Slides | |
| 0:00 | Graph Transduction via Alternating Minimization |
| 0:13 | Outline of the presentation |
| 0:38 | Graph Transduction – Review (1) |
| 1:38 | Graph Transduction – Review (2) |
| 2:48 | Graph Transduction – Review (3) |
| 3:11 | Graph Transduction – Review (4) |
| 4:01 | Graph Transduction – Problem Cases |
| 5:55 | Methodology – Our Choice for ς |
| 6:51 | Methodology–Label Regularizer |
| 8:09 | Methodology – Optimize F |
| 9:39 | Methodology – Gradient Greedy (1) |
| 10:51 | Methodology – Gradient Greedy (2) |
| 10:57 | Methodology – Gradient Greedy (1) |
| 10:59 | Methodology – Gradient Greedy (2) |
| 12:08 | Final Algorithm |
| 12:53 | Some Intuition |
| 13:39 | Intuition |
| 14:14 | Computation Efficiency |
| 14:57 | Experiments –Toy Data |
| 16:37 | Experiments – WebKB Data |
| 17:37 | Experiments – USPS Digits Data |
| 19:02 | Summary |
| 21:06 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !





