Query-Level Stability and Generalization in Learning to Rank
Description
This paper is concerned with the generalization ability of learning to rank algorithms for information retrieval (IR). We point out that the key for addressing the learning problem is to look at it from the viewpoint of query, and we give a formulation of learning to rank for IR based on the consideration. We define a number of new concepts within the framework, including query-level loss, query-level risk, and query-level stability. We then analyze the generalization ability of learning to rank algorithms by giving query-level generalization bounds to them using query-level stability as a tool. Such an analysis is very helpful for us to derive more advanced algorithms for IR. We apply the proposed theory to the existing algorithms of Ranking SVM and IRSVM. Experimental results on the two algorithms verify the correctness of the theoretical analysis.
| Slides | |
| 0:00 | Query-Level Stability and Generalization in Learning to Rank |
| 0:33 | Learning to Rank for Information Retrieval |
| 0:42 | State-of-the-art Approaches |
| 1:34 | Question |
| 2:47 | Information Retrieval as Example |
| 4:22 | Generalization in Learning to Rank for IR |
| 4:52 | Our Work |
| 5:44 | Two-Layer Probabilistic Framework for Ranking |
| 6:38 | Associates in Different Approaches |
| 7:16 | Training Data |
| 7:42 | Query-level Loss and Risk |
| 8:08 | Generalization in Learning to Rank for IR |
| 8:50 | Query-level Stability Theory (1) |
| 10:12 | Query-level Stability Theory (2) |
| 11:21 | Case Study |
| 11:43 | The Algorithms under Investigation |
| 12:24 | Stability of the Algorithms |
| 13:35 | Generalization Bounds of the Algorithms |
| 13:54 | Discussions |
| 14:05 | Generalization Bounds of the Algorithms |
| 14:09 | Discussions |
| 14:13 | Generalization Bounds of the Algorithms |
| 14:20 | Discussions |
| 14:29 | Generalization Bounds of the Algorithms |
| 14:36 | Discussions |
| 15:27 | Experiment (1) (1) |
| 16:34 | Experiment (1) (2) |
| 16:40 | Experiment (1) (1) |
| 16:44 | Experiment (1) (2) |
| 17:05 | Experiment (2) |
| 17:38 | Conclusions |
| 18:14 | Future Work |
| 19:29 | Acknowledgement: |
| 20:32 | - Questions |
| 22:16 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !



