Sign inSign up
Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, Symbol Codes thumbnail
Pause
Mute
Subtitles
Playback speed
0.25
0.5
0.75
1
1.25
1.5
1.75
2
Full screen

Lecture 4: Entropy and Data Compression (III): Shannon's Source Coding Theorem, Symbol Codes

Published on Nov 05, 201219741 Views

David MacKay

Course on Information Theory, Pattern Recognition, and Neural Networks

Related categories

Bayesian LearningNeural NetworksPattern RecognitionInformation Theory

Chapter list

Symbol Codes: Introduction00:00
How To Compress a Redundant File (1)00:27
How To Measure Information Content00:30
Source Coding Theorem01:26
Example: Bent Coin (1)02:48
How We Won The Bent Coin Lottery02:59
Example: Bent Coin (2)04:01
How To Compress a Redundant File (2)04:23
How To Compress a Redundant File (3)05:02
How To Compress a Redundant File (4)05:26
How To Compress a Redundant File (5)06:57
How To Compress a Redundant File (6)07:55
How To Compress a Redundant File (7)08:30
How To Compress a Redundant File (8)09:07
Expected Length Of A Code10:17
How To Compress a Redundant File (9)11:28
How To Compress a Redundant File (10)12:42
How To Compress a Redundant File (11)15:07
How To Compress a Redundant File (12)16:00
How To Compress a Redundant File (13)19:00
How To Compress a Redundant File (14)19:22
How To Compress a Redundant File (15)20:42
How To Compress a Redundant File (16)23:35
How To Compress a Redundant File (17)23:49
How To Compress a Redundant File (18)24:32
How To Compress a Redundant File (19)26:12
How To Compress a Redundant File (20)27:28
How To Compress a Redundant File (21)28:37
How To Compress a Redundant File (22)29:16
How To Compress a Redundant File (23)30:35
How To Compress a Redundant File (24)33:06
How To Compress a Redundant File (25)36:06
The Symbol-Code Supermarket (1)37:22
The Symbol-Code Supermarket (2)38:11
Kraft Inequality38:34
The Symbol-Code Supermarket (3)39:24
The Symbol-Code Supermarket (4)39:27
The Symbol-Code Supermarket (5)39:56
The Symbol-Code Supermarket (6)40:26
The Symbol-Code Supermarket (7)40:33
The Symbol-Code Supermarket (8)40:43
A Complete Code41:23
Ideal Length (1)42:26
Ideal Length (2)44:42
Ideal Length (3)45:31
Ideal Length (4)46:17
Gibbs Inequality (1)47:07
Gibbs Inequality (2)47:48
Gibbs Inequality (3)48:20
Gibbs Inequality (4)50:11
Optimal Symbol Codes (1)51:28
Optimal Symbol Codes (4)52:55
Optimal Symbol Codes (3)53:13
Gibbs Inequality (5)55:28
Symbol Code Summary55:31
Results Without Proof56:03
Homework56:17