The Mathematical Theory Of Communication by Claude Shannon

A foundational exposition of information theory that defines entropy as a quantitative measure of information and models communication with sources, encoders, channels, and decoders. It establishes limits for compression and transmission, including channel capacity, and shows that reliable communication over noisy channels is possible below this threshold through suitable coding. The work examines redundancy, coding efficiency, and trade-offs among rate, noise, and bandwidth, connecting abstract results to practical systems and even natural language.

Purchase from Bookshop.org