event thumbnail image
The 25th International Conference on Machine Learning (ICML 2008)

Fast Nearest Neighbor Retrieval for Bregman Divergences

author: Lawrence Cayton, Department of Computer Science and Engineering, Computer Science Department and Institute for Genomics and Bioinformatics, University of California

Description

We present a data structure enabling efficient NN retrieval for bregman divergences. The family of bregman divergences includes many popular dissimilarity measures including KL-divergence (relative entropy), Mahalanobis distance, and Itakura-Saito divergence. These divergences present a challenge for efficient NN retrieval because they are not, in general, metrics, for which most NN data structures are designed. The data structure introduced in this work shares the same basic structure as the popular metric ball tree, but employs convexity properties of bregman divergences in place of the triangle inequality. Experiments demonstrate speedups over brute-force search of up to several orders of magnitude.

You might be experiencing some problems with Your Video player.
Slides
0:00 Fast nearest neighbor retrieval for bregman divergences
0:03 Nearest neighbor search
2:05 Bregman divergence def
2:36 Bregman divergence examples
3:17 Bregman divergences VS metrics - 1
3:56 Bregman divergences VS metrics - 2
4:22 Review: tree-based NN retrieval
5:37 Bregman ball trees
6:32 Bbtree: build - 1
7:18 Bbtree: build - 2
7:36 Bbtree: search
8:57 Computing the bound - 1
9:05 Computing the bound - 2
9:54 The ! 2/2 case
10:34 The general case - 1
10:42 The general case - 2
11:06 The general case - 3
11:44 The general case - 4
12:19 Algorithm - 1
12:36 Algorithm - 2
12:52 Algorithm - 3
13:05 Algorithm - 4
13:31 Experiments: KL-divergence
13:42 Data sets
14:40 Approx search experiments
15:17 Approximate search
16:02 Rcv data
16:13 Corel, semantic space, SIFT
16:40 Exact search
17:08 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: