MIT Subject Listing & Schedule
Fall 2025 Search Results

Searched for:

1 subject found.

6.7470 Information Theory

()
Prereq: 6.3700
Units: 3-0-9
Credit cannot also be received for 6.7480
Subject Cancelled

Mathematical definitions of information measures, convexity, continuity, and variational properties. Lossless source coding; variable-length and block compression; Slepian-Wolf theorem; ergodic sources and Shannon-McMillan theorem. Hypothesis testing, large deviations and I-projection. Fundamental limits of block coding for noisy channels: capacity, dispersion, finite blocklength bounds. Coding with feedback. Joint source-channel problem. Rate-distortion theory, vector quantizers. Advanced topics include Gelfand-Pinsker problem, multiple access channels, broadcast channels (depending on available time).
M. Medard, L. Zheng