Location: Workshop on Web Search Click Data

event thumbnail image

Workshop on Web Search Click Data

Comparative Analysis of Clicks and Judgments for IR Evaluation

author:Jaap Kamps, University of Amsterdam
author:Marijn Koolen, University of Amsterdam
author:Andrew Trotman, University of Otago
published: March 12, 2009, recorded: February 2009, views: 37

Turn off the lights

You might be experiencing some problems with Your Video player.

Slides

Slides
0:00	Comparative Analysis of Clicks and Judgments for IR Evaluation
0:48	Overview
1:24	IR Evaluation
2:50	Idea of the Paper
3:53	Three Sets of Data
5:12	(1) INEX 2008 Ad Hoc Track Test Collection
6:33	(2) New Zealand Proxy Log
8:30	(3) MSN Log
9:53	Wikipedia Clicks in the Logs
10:56	Distribution of Relevant Docs
11:54	Impact on System Ranking?
12:39	System Ranking (Top 10)
14:06	System Rank Correlation (163 runs)
15:23	Significant Differences
17:33	What’s the Bias?
18:25	Title Bias
19:38	Discussion and Conclusions

Related content

Visitors who watched this lecture also watched...

Analysis of Long Queries in a Large Scale Search Log
81 views - Bruce Croft, Michael Bendersky, 2009

Is Wikipedia Link Structure Different?
31 views - Jaap Kamps, Marijn Koolen, 2009

Challenges in Building Large-Scale Information Retrieval Systems
4086 views - Jeffrey Dean, 2009

Document Analysis
161 views - Wray Buntine, 2009

Intentional Query Suggestion: Making User Goals More Explicit During Search
74 views - Markus Strohmaier, Mark Kröll, Christian Körner, 2009

Query Suggestions Using Query-Flow Graphs
81 views - Sebastiano Vigna, Carlos Castillo, Paolo Boldi, Debora Donato, Francesco Bonchi, 2009

Mining Queries
241 views - Ricardo Baeza-Yates, 2007

Mining Large Graphs: Laws and Tools
3417 views - Jure Leskovec, 2007

Exploiting Cluster Structure to Predict The Labeling of a Graph
55 views - Mark Herbster, 2008

Finding dense subgraphs with size bounds
56 views - Reid Andersen, Kumar Chellapilla, 2009

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Lecture popularity: You need to login to cast your vote.

See Also:

Download slides icon Download slides: wscd09_kamps_cacjire_01.pdf (73.1 KB)

Launch Windows Media Player Launch in a standalone WM Player

WMedia Player Switch to Windows Media Player

Help icon Streaming Video Help

WebLink icon Windows Media Player Firefox Plugin - Download

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

Comment
Name
Email address
URL

make sure you have javascript enabled or clear this field: