event thumbnail image
The 25th International Conference on Machine Learning (ICML 2008)

Query-Level Stability and Generalization in Learning to Rank

author: Tie-Yan Liu, Microsoft Research

Description

This paper is concerned with the generalization ability of learning to rank algorithms for information retrieval (IR). We point out that the key for addressing the learning problem is to look at it from the viewpoint of query, and we give a formulation of learning to rank for IR based on the consideration. We define a number of new concepts within the framework, including query-level loss, query-level risk, and query-level stability. We then analyze the generalization ability of learning to rank algorithms by giving query-level generalization bounds to them using query-level stability as a tool. Such an analysis is very helpful for us to derive more advanced algorithms for IR. We apply the proposed theory to the existing algorithms of Ranking SVM and IRSVM. Experimental results on the two algorithms verify the correctness of the theoretical analysis.

You might be experiencing some problems with Your Video player.
Slides
0:00 Query-Level Stability and Generalization in Learning to Rank
0:33 Learning to Rank for Information Retrieval
0:42 State-of-the-art Approaches
1:34 Question
2:47 Information Retrieval as Example
4:22 Generalization in Learning to Rank for IR
4:52 Our Work
5:44 Two-Layer Probabilistic Framework for Ranking
6:38 Associates in Different Approaches
7:16 Training Data
7:42 Query-level Loss and Risk
8:08 Generalization in Learning to Rank for IR
8:50 Query-level Stability Theory (1)
10:12 Query-level Stability Theory (2)
11:21 Case Study
11:43 The Algorithms under Investigation
12:24 Stability of the Algorithms
13:35 Generalization Bounds of the Algorithms
13:54 Discussions
14:05 Generalization Bounds of the Algorithms
14:09 Discussions
14:13 Generalization Bounds of the Algorithms
14:20 Discussions
14:29 Generalization Bounds of the Algorithms
14:36 Discussions
15:27 Experiment (1) (1)
16:34 Experiment (1) (2)
16:40 Experiment (1) (1)
16:44 Experiment (1) (2)
17:05 Experiment (2)
17:38 Conclusions
18:14 Future Work
19:29 Acknowledgement:
20:32 - Questions
22:16 - Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: