About
A series of sixteen lectures covering the core of the book [[http://www.inference.phy.cam.ac.uk/mackay/itila/| "Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)" ]] which can be bought at Amazon , and is available free online . A subset of these lectures used to constitute a Part III Physics course at the University of Cambridge. The high-resolution videos and all other course material can be downloaded from the Cambridge course website .
Videos

Lecture 6: Noisy Channel Coding (I): Inference and Information Measures for Nois...
Nov 5, 2012
·
16611 views

Lecture 11: Approximating Probability Distributions (I): Clustering As An Exampl...
Nov 5, 2012
·
13586 views

Lecture 15: Data Modelling With Neural Networks (I): Feedforward Networks: The C...
Nov 5, 2012
·
15811 views

Lecture 5: Entropy and Data Compression (IV): Shannon's Source Coding Theorem, S...
Nov 5, 2012
·
17963 views

Lecture 3: Entropy and Data Compression (II): Shannon's Source Coding Theorem an...
Nov 5, 2012
·
22505 views

Lecture 8: Noisy Channel Coding (III): The Noisy-Channel Coding Theorem
Nov 5, 2012
·
14505 views

Lecture 1: Introduction to Information Theory
Nov 5, 2012
·
146618 views

Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, ...
Nov 5, 2012
·
19855 views

Lecture 7: Noisy Channel Coding (II): The Capacity of a Noisy Channel
Nov 5, 2012
·
13987 views

Lecture 14: Approximating Probability Distributions (IV): Variational Methods
Nov 5, 2012
·
14849 views

Lecture 16: Data Modelling With Neural Networks (II): Content-Addressable Memori...
Nov 5, 2012
·
13388 views

Lecture 12: Approximating Probability Distributions (II): Monte Carlo Methods (I...
Nov 5, 2012
·
21122 views

Lecture 13: Approximating Probability Distributions (III): Monte Carlo Methods (...
Nov 5, 2012
·
13887 views

Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Infor...
Nov 5, 2012
·
36754 views

Lecture 10: An Introduction To Bayesian Inference (II): Inference Of Parameters ...
Nov 5, 2012
·
21360 views

Lecture 9: A Noisy Channel Coding Gem, And An Introduction To Bayesian Inference...
Nov 5, 2012
·
15005 views