Course on Information Theory, Pattern Recognition, and Neural Networks

produced by: David MacKay (University of Cambridge)
author: David MacKay, University of Cambridge

A series of sixteen lectures covering the core of the book "Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)" which can be bought at Amazon, and is available free online. A subset of these lectures used to constitute a Part III Physics course at the University of Cambridge. The high-resolution videos and all other course material can be downloaded from the Cambridge course website.

Categories

Top » Computer Science » Information Theory
Top » Computer Science » Machine Learning » Pattern Recognition
Top » Computer Science » Machine Learning » Neural Networks
Top » Computer Science » Machine Learning » Bayesian Learning


[syn] 144337 views, 1:01:51 Lecture 1: Introduction to Information TheoryLecture 1: Introduction to Information Theory David MacKay David MacKay 24 comments	[syn] 36119 views, 51:08 Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Information Theory and EntropyLecture 2: Entropy and Data Compression (I): Introduction to Compression, ... David MacKay David MacKay	[syn] 22140 views, 51:00 Lecture 3: Entropy and Data Compression (II): Shannon's Source Coding Theorem and the Bent Coin LotteryLecture 3: Entropy and Data Compression (II): Shannon's Source Coding ... David MacKay David MacKay 1 comment	[syn] 19539 views, 56:56 Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, Symbol CodesLecture 4: Entropy and Data Compression (III): Shannon's Source Coding ... David MacKay David MacKay 1 comment	[syn] 17659 views, 1:02:47 Lecture 5: Entropy and Data Compression (IV): Shannon's Source Coding Theorem, Symbol Codes and Arithmetic CodingLecture 5: Entropy and Data Compression (IV): Shannon's Source Coding ... David MacKay David MacKay 2 comments
[syn] 16338 views, 54:41 Lecture 6: Noisy Channel Coding (I): Inference and Information Measures for Noisy ChannelsLecture 6: Noisy Channel Coding (I): Inference and Information Measures ... David MacKay David MacKay 1 comment	[syn] 13824 views, 46:53 Lecture 7: Noisy Channel Coding (II): The Capacity of a Noisy ChannelLecture 7: Noisy Channel Coding (II): The Capacity of a ... David MacKay David MacKay 11 comments	[syn] 14283 views, 1:08:58 Lecture 8: Noisy Channel Coding (III): The Noisy-Channel Coding TheoremLecture 8: Noisy Channel Coding (III): The Noisy-Channel Coding Theorem David MacKay David MacKay 2 comments	[syn] 14776 views, 48:35 Lecture 9: A Noisy Channel Coding Gem, And An Introduction To Bayesian Inference (I)Lecture 9: A Noisy Channel Coding Gem, And An Introduction ... David MacKay David MacKay 1 comment	[syn] 21029 views, 1:15:52 Lecture 10: An Introduction To Bayesian Inference (II): Inference Of Parameters And ModelsLecture 10: An Introduction To Bayesian Inference (II): Inference Of ... David MacKay David MacKay
[syn] 13392 views, 56:55 Lecture 11: Approximating Probability Distributions (I): Clustering As An Example Inference Problem Lecture 11: Approximating Probability Distributions (I): Clustering As An Example ... David MacKay David MacKay	[syn] 20859 views, 1:23:47 Lecture 12: Approximating Probability Distributions (II): Monte Carlo Methods (I): Importance Sampling, Rejection Sampling, Gibbs Sampling, Metropolis MethodLecture 12: Approximating Probability Distributions (II): Monte Carlo Methods (I): ... David MacKay David MacKay 5 comments	[syn] 13693 views, 1:47:56 Lecture 13: Approximating Probability Distributions (III): Monte Carlo Methods (II): Slice Sampling, Hybrid Monte Carlo, Over-relaxation, Exact Sampling Lecture 13: Approximating Probability Distributions (III): Monte Carlo Methods (II): ... David MacKay David MacKay	[syn] 14632 views, 46:34 Lecture 14: Approximating Probability Distributions (IV): Variational MethodsLecture 14: Approximating Probability Distributions (IV): Variational Methods David MacKay David MacKay 3 comments	[syn] 15661 views, 1:27:15 Lecture 15: Data Modelling With Neural Networks (I): Feedforward Networks: The Capacity Of A Single Neuron, Learning As InferenceLecture 15: Data Modelling With Neural Networks (I): Feedforward Networks: ... David MacKay David MacKay 1 comment
[syn] 13199 views, 1:36:32 Lecture 16: Data Modelling With Neural Networks (II): Content-Addressable Memories And State-Of-The-Art Error-Correcting Codes Lecture 16: Data Modelling With Neural Networks (II): Content-Addressable Memories ... David MacKay David MacKay

Reviews and comments:

1 Emily, January 20, 2013 at 11:09 p.m.:

Thank you so much for making this free! I loved the book and the video lectures and I deeply appreciate the work that went into them.

2 Igor Vieira, April 9, 2015 at 3:37 p.m.:

Thank you so much: really important and good material as well... And for free!! :-)

3 Jon, May 1, 2015 at 3:22 p.m.:

Really fantastic resource that I found highly valuable. Thanks for sharing!

4 Qi Wang, January 9, 2016 at 5:51 a.m.:

Thank you for good course. But would you like supply subtitle? I'm not a English-speaking.

5 FAU Student, February 9, 2016 at 2:45 p.m.:

I hope your colleague Ralf Müller behaves well on the exam today.

6 Nahuel, July 18, 2016 at 10:35 p.m.:

Seriously, thank you very much

7 FAU Student, January 8, 2017 at 12:18 p.m.:

Thank you so much professor. This will be really helpful for my exams (held by your colleague Prof.Ralf Muller) :)

8 Zhao, February 16, 2017 at 11:54 a.m.:

Thank you for the very excellent course! Learned a lot from Professor Mackay! It'll be nicer if some subtitle is supplied :)

9 Ali Hummos, May 28, 2018 at 4:32 a.m.:

Even if posthumously, I thank you professor McKay for this valuable resource. RIP.

10 Ayush Thada, December 17, 2018 at 7:58 p.m.:

This is a great lecture series and it has improved my understanding of Information theory. Thank you, sir, for making quality educational content accessible for students like me.

11 remix, April 29, 2019 at 10:10 a.m.:

I like this article because here more things available for us
https://rememberpasswordsinmicrosofte... and here i want to get more benefit for the enjoy.

12 Anny, July 8, 2019 at 3:38 p.m.:

I teach social anthropology. I am constantly engaged in researching the principles of obtaining and using power in different societies, the economic behavior of people, I identify factors that affect the economy, but not taken into account by economics. But I would like to write all this in my research papers. I am very interested to read your articles since I find practical advice for myself.
I already know that the most important and first exercise for a writer is writing an essay.
But I would like to earn in my writing. So that students could buy various research papers from me https://answershark.com/anthropology....
Writing is hard work. I still need a lot of time to learn.

13 Brown, September 15, 2019 at 8:06 p.m.:

Cambridge university offers the students a great for recovering the course materials.They may make their assignment from taking help from this site https://australianwritings.com.au/ for taking well preparation for the examination.All the links are useful for the students who missed the real class.

14 Angelina Pottie, October 11, 2019 at 5:09 p.m.:

Really cool article

15 Russo, January 21, 2020 at 6:05 a.m.:

Thanks for taking the time to post such valuable information... https://www.fjgaragedoorrepair.com/

16 EarthTechy, May 23, 2020 at 12:49 p.m.:

Free Hollywood Movies Download in HD – Top 10 Websites
https://www.earthtechy.com/hollywood-...

17 chrisgail, June 1, 2020 at 6:13 a.m.:

Cambridge University is one of the best Universities in the work. I like to watch here video lecture as the expert writers of https://www.affordable-dissertation.c...
provide writing skills to the students by video link.

18 Columbus Concrete Installation, June 22, 2020 at 5:28 p.m.:

Great information, thank you for sharing it!

-Tony, owner of http://www.columbusconcreteinstallati... and http://www.landscapeservicepasadena.com

19 FIle Group, October 30, 2020 at 5:24 p.m.:

We commend you for all the things you have discussed.

https://thefilegroup.com/

20 Cincinnati SEO, October 30, 2020 at 5:26 p.m.:

I think we can make use of some info here.

https://cincinnati-seo.org/

21 Paul Casey, January 13, 2021 at 3:48 a.m.:

Great post! We'll be sharing this with our buddies studying AI in Orlando, FL.

Thanks! - Paul, owner of http://www.orlandocardetail.com

22 Bernice Leanard, January 13, 2021 at 11:31 a.m.:

More blogs like this please.
https://www.housecleanersk.ca/

23 Rafael Sant'Anna, January 18, 2021 at 4:47 p.m.:

Great blog!
Thanks, Rafael @ https://simplyphotoboothsca.com

24 Ismael Madara, January 23, 2021 at 10:28 a.m.:

Looking for fresh buyers? Receive hundreds of keyword targeted visitors directly to your site. Boost revenues super fast. Start seeing results in as quick as a few hours. To get details Check out: http://bit.ly/your-niche-traffic

25 Lindsey, February 20, 2021 at 8:30 a.m.:

Your content is great. Very impressive. Keep posting for us. https://thebestcbdcreams.com/cbd-crea...

26 Tracey, May 29, 2021 at 12:07 p.m.:

Great post as always!
https://www.emergencycleaningpros.com/

27 Gally, June 26, 2021 at 4:07 a.m.:

Amazing lecture as usual! www.houseflipfunding.com/

28 Alma, July 9, 2021 at 8:25 a.m.:

Thank you! www.socleansyracuse.com/

29 Rita, July 17, 2021 at 8:31 a.m.:

Enjoyed all the lectures! https://www.onlinemarketingshark.com/

30 Marie, July 22, 2021 at 9:20 p.m.:

Awesome videos are on this site. Great work! https://www.ftlauderdaleweddingplanne...