Practical Guide to Controlled Experiments on the Web: Listen to Your Customers not to the HiPPO

author:Ronny Kohavi, Microsoft
published: Nov. 19, 2008, recorded: October 2008, views: 330

You might be experiencing some problems with Your Video player.

Slides

Slides
0:00	Conference on Information and Knowledge Management
0:18	Practical Guide to Controlled Experiments on the Web
0:24	Amazon Shopping Cart Recs
2:04	Agenda
3:10	Controlled Experiments
3:42	Examples
4:41	Office Online (1)
5:35	Office Online (2)
6:09	MSN Home Page Search Box
7:10	Search Box
7:32	Microsoft Support (1)
8:32	Microsoft Support (2)
8:45	Hard to Assess the Value of Ideas: Data Trumps Intuition
11:05	Agenda (2)
11:17	The Cultural Challenge
12:03	Experimentation Culture
13:15	The OEC
14:32	Agenda (3)
14:39	Typical Discovery
15:07	Correlations are not Necessarily Causal
16:16	Advantages of Controlled Experiments
17:03	Issues with Controlled Experiments (1)
19:06	Issues with Controlled Experiments (2)
21:09	Experimentation Platform Team
21:48	Summary
23:31	Thank you

Related content

Visitors who watched this lecture also watched...

22:40

Practical Guide to Controlled Experiments on the Web: Listen to Your Customers not to the HiPPO
1311 views - Ron Kohavi, 2007

01:20:35

Lecture 1: Administrivia, Introduction, Analysis of Algorithms, Insertion Sort, Mergesort
6210 views - Charles E. Leiserson, 2005

03:54:31

Support Vector Machines
15399 views - Chih-Jen Lin, 2006

01:05:00

Challenges in Building Large-Scale Information Retrieval Systems
4851 views - Jeffrey Dean, 2009

15:25

Seven Pitfalls to Avoid when Running Controlled Experiments on the Web
20 views - Thomas Crook, 2009

01:10:31

Lecture 2: Asymptotic Notation, Recurrences, Substitution, Master Method
5516 views - Erik Demaine, 2005

04:59:19

Machine Learning, Probability and Graphical Models
21384 views - Sam Roweis, 2006

01:00:47

Gaussian Process Basics
15055 views - David MacKay, 2006

02:39:32

Data Mining and Knowledge Discovery
1689 views - Nada Lavrač, 2007

05:25:02

Log-linear Models and Conditional Random Fields
1530 views - Charles Elkan, 2008

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Lecture popularity: You need to login to cast your vote.

We are currently conducting a short survey. We value your feedback, and would appreciate if you took a few moments to respond to some questions. Click here to take the survey.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

1 Mark Liu, May 6, 2009 at 8:17 a.m.:

I feel that what was displayed in this video concerning website testing is an excellent strategy to implement in one's own shopping cart site. Even though the content in the video was a little difficult to follow along, I have to say that website testing is a tactic that is new to me and is an area I will experiment more with.

Write your own review or comment:

Comment
Name
Email address
URL

make sure you have javascript enabled or clear this field:

Practical Guide to Controlled Experiments on the Web: Listen to Your Customers not to the HiPPO

Slides

Related content

Report a problem or upload files

See Also:

Link this page

Reviews and comments:

Write your own review or comment:

EDITOR’S PICKS

FEATURED CONFERENCES

BLOG POSTS

INFO