0.25
0.5
0.75
1.25
1.5
1.75
2
Towards On-the-fly Large Scale Video Search
Published on Jul 30, 20144763 Views
We would like to be able to find anything in an image or video dataset. The talk will describe our progress on visual search for finding people, specific objects and categories in large scale video da
Related categories
Chapter list
Towards On-the-fly Large Scale Video Search00:00
The Vision00:01
The Problem - 100:58
The Problem - 201:14
The Solution01:33
On-the-fly search for faces01:51
Video dataset: BBC TV - 102:47
Instance Search - Example "Mona Lisa"03:28
Outline04:11
Long history of learning from Google images05:16
On-the-fly Instance Search05:28
Instance Search05:31
Visual engine: bag of visual words particular object retrieval 06:16
Example - 109:05
Example - 209:11
Spatial verification09:23
Visual engine: bag of visual words particular object retrieval 09:53
Oxford buildings dataset10:17
Query images11:08
Total Recall12:15
Improving SIFT12:26
Hellinger distance - 113:30
Hellinger distance - 215:08
Hellinger distance - 315:31
Bag of visual words particular object retrieval - 116:00
Bag of visual words particular object retrieval - 216:02
RootSIFT: mAP performance16:12
RootSIFT: results, Oxford 5k17:23
Why does it work better?17:37
RootSIFT Advantages18:21
Other significant improvements … 18:48
On-the-fly Instance Search19:00
How are positive images used for instance search?20:01
Video dataset: BBC TV - 222:18
Instance Search - Example "Buckingham Palace"22:24
On-the-fly Category Search23:37
Image classification - 124:07
Image classification - 225:25
Image Encoding25:50
Evolution of encodings … 27:44
Encoding the Descriptor Distribution - 128:03
Encoding the Descriptor Distribution - 229:05
Encoding the Descriptor Distribution - 329:14
Encoding the Descriptor Distribution - 429:45
VLAD - Encoding29:57
Visual Category Search – Examples "Car"34:30
Video dataset: BBC TV - 336:00
Evolution of Encoding Methods36:07
VLAD Data Stats36:52
Visual Category Search - Examples "Cityscape"39:25
On-the-fly Visual Category Search40:01
On-the-fly Face Search40:07
Feature vectors for face (tracks)40:21
On-the-fly Person Retrieval42:15
Video dataset: BBC TV - 443:01
Face Search - Examples "Queen Elizabeth"43:05
Face Data Stats44:12
Facial attributes - FaceTracer project45:00
Face Search - Examples "Moustache"45:58
Datasets47:18
Face Search on 40 k hrs - Example "Obama’"47:56
How can performance be improved?49:46
The Vision49:59