Information Theory (Short Course)

I delivered a short, six hour version of my Information Theory course at Tsinghua University from Nov. 28th to Dec. 2nd, 2014.



The material in lectures 1 and 2 are directly from the longer version of my Information Theory course. The primary reference for almost all that material is MacKay’s Information Theory, Inference, and Learning Algorithms and, to a lesser extent, Cover & Thomas’s Elements of Information Theory.

Lecture 3 draws on a variety of material, including: