Information Theory in 80 Pages by James V Stone

Information Theory in 80 Pages by James V Stone

This short and richly illustrated book introduces the essential mathematics required to understand information theory. Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. Accessible examples are used to introduce information theory in terms of everyday games like 20 questions before more advanced topics are explored. Online Matlab and Python computer code provides hands-on experience of information theory in action. Written in an informal style, with a comprehensive glossary, this concise text is an ideal primer for novices who wish to gain a firm grasp of the essential principles of information theory.

James V.Stone is a Reader at the University of Sheffield's Psychology Department. He is one of the coauthors (together with John P. Frisby) is the author of Independent Component Analysis: A Tutorial Introduction (MIT Press, 2004) and the widely used classic Seeing: The Computational Approach to Biological Vision (second edition, MIT Press, 2010).