Fast Nearest Neighbor Retrieval for Bregman Divergences
author:
Lawrence Cayton,
Department of Computer Science and Engineering, Computer Science Department and Institute for Genomics and Bioinformatics, University of California
Description
We present a data structure enabling efficient NN retrieval for bregman divergences. The family of bregman divergences includes many popular dissimilarity measures including KL-divergence (relative entropy), Mahalanobis distance, and Itakura-Saito divergence. These divergences present a challenge for efficient NN retrieval because they are not, in general, metrics, for which most NN data structures are designed. The data structure introduced in this work shares the same basic structure as the popular metric ball tree, but employs convexity properties of bregman divergences in place of the triangle inequality. Experiments demonstrate speedups over brute-force search of up to several orders of magnitude.
You might be experiencing some problems with Your Video player.
| Slides | |
| 0:00 | Fast nearest neighbor retrieval for bregman divergences |
| 0:03 | Nearest neighbor search |
| 2:05 | Bregman divergence def |
| 2:36 | Bregman divergence examples |
| 3:17 | Bregman divergences VS metrics - 1 |
| 3:56 | Bregman divergences VS metrics - 2 |
| 4:22 | Review: tree-based NN retrieval |
| 5:37 | Bregman ball trees |
| 6:32 | Bbtree: build - 1 |
| 7:18 | Bbtree: build - 2 |
| 7:36 | Bbtree: search |
| 8:57 | Computing the bound - 1 |
| 9:05 | Computing the bound - 2 |
| 9:54 | The ! 2/2 case |
| 10:34 | The general case - 1 |
| 10:42 | The general case - 2 |
| 11:06 | The general case - 3 |
| 11:44 | The general case - 4 |
| 12:19 | Algorithm - 1 |
| 12:36 | Algorithm - 2 |
| 12:52 | Algorithm - 3 |
| 13:05 | Algorithm - 4 |
| 13:31 | Experiments: KL-divergence |
| 13:42 | Data sets |
| 14:40 | Approx search experiments |
| 15:17 | Approximate search |
| 16:02 | Rcv data |
| 16:13 | Corel, semantic space, SIFT |
| 16:40 | Exact search |
| 17:08 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Visitors who watched this lecture also watched...
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




