Course on Information Theory, Pattern Recognition, and Neural Networks

Course on Information Theory, Pattern Recognition, and Neural Networks

16 Lectures · Feb 20, 2012

About

A series of sixteen lectures covering the core of the book [[http://www.inference.phy.cam.ac.uk/mackay/itila/| "Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)" ]] which can be bought at Amazon , and is available free online . A subset of these lectures used to constitute a Part III Physics course at the University of Cambridge. The high-resolution videos and all other course material can be downloaded from the Cambridge course website .

Related categories

Uploaded videos:

video-img
01:01:51

Lecture 1: Introduction to Information Theory

David MacKay

Nov 05, 2012

 · 

145920 Views

Lecture
video-img
51:08

Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Infor...

David MacKay

Nov 05, 2012

 · 

36531 Views

Lecture
video-img
51:00

Lecture 3: Entropy and Data Compression (II): Shannon's Source Coding Theorem an...

David MacKay

Nov 05, 2012

 · 

22395 Views

Lecture
video-img
56:56

Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, ...

David MacKay

Nov 05, 2012

 · 

19761 Views

Lecture
video-img
01:02:47

Lecture 5: Entropy and Data Compression (IV): Shannon's Source Coding Theorem, S...

David MacKay

Nov 05, 2012

 · 

17836 Views

Lecture
video-img
54:41

Lecture 6: Noisy Channel Coding (I): Inference and Information Measures for Nois...

David MacKay

Nov 05, 2012

 · 

16498 Views

Lecture
video-img
46:53

Lecture 7: Noisy Channel Coding (II): The Capacity of a Noisy Channel

David MacKay

Nov 05, 2012

 · 

13912 Views

Lecture
video-img
01:08:58

Lecture 8: Noisy Channel Coding (III): The Noisy-Channel Coding Theorem

David MacKay

Nov 05, 2012

 · 

14432 Views

Lecture
video-img
48:35

Lecture 9: A Noisy Channel Coding Gem, And An Introduction To Bayesian Inference...

David MacKay

Nov 05, 2012

 · 

14930 Views

Lecture
video-img
01:15:52

Lecture 10: An Introduction To Bayesian Inference (II): Inference Of Parameters ...

David MacKay

Nov 05, 2012

 · 

21250 Views

Lecture
video-img
56:55

Lecture 11: Approximating Probability Distributions (I): Clustering As An Exampl...

David MacKay

Nov 05, 2012

 · 

13527 Views

Lecture
video-img
01:23:47

Lecture 12: Approximating Probability Distributions (II): Monte Carlo Methods (I...

David MacKay

Nov 05, 2012

 · 

21047 Views

Lecture
video-img
01:47:56

Lecture 13: Approximating Probability Distributions (III): Monte Carlo Methods (...

David MacKay

Nov 05, 2012

 · 

13821 Views

Lecture
video-img
46:34

Lecture 14: Approximating Probability Distributions (IV): Variational Methods

David MacKay

Nov 05, 2012

 · 

14792 Views

Lecture
video-img
01:27:15

Lecture 15: Data Modelling With Neural Networks (I): Feedforward Networks: The C...

David MacKay

Nov 05, 2012

 · 

15755 Views

Lecture
video-img
01:36:32

Lecture 16: Data Modelling With Neural Networks (II): Content-Addressable Memori...

David MacKay

Nov 05, 2012

 · 

13336 Views

Lecture