Material Insights · Understanding the Material World

Information theory: Technologies

Technologies

The technologies that rely on it, and how each one uses it

Relied on by 11
  • PCM Digital telephony (PCM) Binary pulses can be sent reliably through noise as long as the rate stays below the channel's capacity [1].
  • TCP Internet (TCP/IP) Once a message is turned into bits, the same protocols can carry text, sound and pictures alike.
  • Pkt Packet switching Treating messages as strings of bits is what lets any message be cut into equal blocks and sent the same way.
  • WWW World Wide Web Text, images and video on the web are all sent as bits, the unit of information that Shannon's theory made the basis of communication.
  • Eml Electronic mail Text, pictures and files all become strings of bits, so one mail system can carry any of them.
  • Abc Alphabet Information theory counts how much each symbol of a writing system carries, which is why ordinary text can be compressed.
  • Cmz Lossy image, audio and video compression Compression works because real signals are full of redundancy, and the theory shows how far data can be squeezed.
  • LLM Large language models Language models are trained to predict the next piece of text, and their prediction error is measured in the same terms as Shannon's measure of information.
  • GUI Graphical user interface The difficulty of pointing at a target is measured in bits, borrowing the unit of information theory, and is used to size buttons and menus.
  • Str Internet video streaming Video is sent as bits at a rate chosen to fit what the link can carry, and adaptive streaming switches between versions as that rate changes.
  • EW Electronic warfare In principle terms, noise limits how much a channel can carry, and interference works by adding noise.
Limits 7

as of 2026-11-12

Sources

  1. A Mathematical Theory of Communication The Bell System Technical Journal (C. E. Shannon), 1948
  2. Channel Coding: The Road to Channel Capacity Proceedings of the IEEE, on arXiv (D. J. Costello Jr. and G. D. Forney Jr.), 2006