Order-Embeddings of Images and Language thumbnail
slide-image
Pause
Mute
Subtitles not available
Playback speed
0.25
0.5
0.75
1
1.25
1.5
1.75
2
Full screen

Order-Embeddings of Images and Language

Published on May 27, 20164019 Views

Hypernymy, textual entailment, and image captioning can be seen as special cases of a single visual-semantic hierarchy over words, sentences, and images. In this paper we advocate for explicitly model

Related categories

Chapter list

Order-Embeddings of Images and Language00:00
Semantic Image Search00:16
What is the relationship between images and the language00:37
Untitled00:53
Visual Semantic Hierarchy - 100:57
Modeling the Visual-Semantic Hierarchy02:53
Ordered Embedding Space - 103:48
Ordered Embedding Space - 205:06
Order violation error - 107:05
Order violation error - 207:44
Order violation error - 307:51
Order violation error - 407:53
Experiments08:12
Visual Semantic Hierarchy - 208:15
Image Search w. Visual-Semantic Embeddings08:38
MS-COCO Ranking Benchmark - 110:26
MS-COCO Ranking Benchmark - 210:39
Evaluation (Image Search)10:51
Quantitative Results - 111:18
Quantitative Results - 211:39
Quantitative Results - 311:52
Image Search Examples: Success12:06
Image Search Examples: Failure - 112:17
Image Search Examples: Failure - 212:31
Multimodal Regularities - 112:36
Multimodal Regularities - 213:06
Query - 114:08
Query - 214:37
Query - 314:42
Conclusions15:23