Conditional entropy and mutual information
We will consider the problem of transmitting information over a noisy channel, and arrive at Shannon’s channel-coding theorem, in which the notion of mutual information of random variables plays a central role.
Key concepts: Conditional entropy, chain rule for mutual information, capacity of a channel.
