Information Theory

author: David MacKay, University of Cambridge
published: Nov. 2, 2009,   recorded: August 2009,   views: 69793


Related Open Educational Resources

Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:26:35
Watch Part 2
Part 2 1:35:39

See Also:

Download slides icon Download slides: mlss09uk_mackay_it.pdf (3.1┬áMB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 raghvendra, December 1, 2010 at 12:42 a.m.:

realy very good

Comment2 eliot, January 7, 2012 at 8:43 a.m.:

skillful lecturer

Comment3 Bart Alder, August 8, 2012 at 7:28 a.m.:


Comment4 mahdie, February 20, 2013 at 7:34 p.m.:

very good

Comment5 nuur, August 16, 2013 at 3:53 p.m.:


Comment6 Julien, April 16, 2018 at 7:59 p.m.:

I have issue with the example using cards. The correct answer is 1/2. Proof:

A card is a pair of colors:

c1 = (R, R)
c2 = (R, W)
c3 = (W, W)

We choose a card (x,y) at random.

I see red, so I know x = R. He then asks P(y = R | x = R)

P(y = R | x = R) = P(x = R, y = R) / P(x = R)
= p(card = c1) / p(card = c1 or card = c2)
= p(card = c1) / (p(card = c1) + p(card = c2))
= 1 / 2

Why does he say 2/3?

Write your own review or comment:

make sure you have javascript enabled or clear this field: