Information Theory and Coding by Marcelo Sampaio De Alencar

Information Theory and Coding by Marcelo Sampaio De Alencar

This book offers a rigorous yet accessible introduction to information theory, bridging the gap between abstract mathematics and real-world applications. Beginning with the historical evolution of the field, it builds a strong foundation through essential concepts in set theory, measure theory, probability, and entropy—core pillars for understanding modern information systems.

Designed to address the disconnect between highly theoretical texts and overly simplified engineering approaches, the book presents a seamless, integrated treatment of mathematical fundamentals and practical insight. It equips readers with the tools needed to model, analyze, and design systems in a rapidly evolving technological landscape.

Rich with examples, illustrations, and graphical explanations, the text supports intuitive learning while maintaining mathematical rigor. Carefully curated appendices provide additional depth, including Fourier transforms in one and two dimensions, as well as key formulas and inequalities.

Ideal for undergraduate students, engineers, and professionals across engineering, mathematics, statistics, physics, economics, and information technology, this book serves as both a comprehensive textbook and a long-term reference. A background in calculus is recommended.

Marcelo Sampaio de Alencar was born in Serrita, Brazil, in 1957. He received his bachelor degree in electrical engineering, from the Federal University of Pernambuco (UFPE), Brazil, 1980, his master degree in electrical engineering, from the Federal University of Paraiba (UFPB), Brazil, 1988 and his Ph.D. from the University of Waterloo, Department of Electrical and Computer Engineering, Canada, 1993. He has 47 years of engineering experience, and 37 years as an IEEE Member, currently as a life senior member. Marcelo Alencar has supervised 7 post-doctoral researchers, 23 doctoral thesis, 36 master dissertations, two graduate monographies and several undergraduate students. He is the founder and president of the Institute for Advanced Studies in Communications (Iecom). He has published over 560 engineering and scientific papers, and 31 books. He has also written chapters for 14 books. Marcelo S. Alencar has contributed in different capacities to the several international scientific journals and he has been involved as a volunteer with several IEEE and SBrT activities, including being a member of the Advisory or Technical Program Committee for several events. He was a columnist of the traditional Brazilian newspaper Jornal do Commercio for two decades, and he was vice-president external relations of SBrT. He is a member of the IEEE, IEICE, in Japan, SBrT, SBMO, SBPC, ABJC and SBEB, in Brazil. He studied acoustic guitar at the Federal University of Paraiba, and keyboard and bass at the music school Musidom. He is composer and percussionist of the famous carnival club Bola de Ferro, in Recife, Brazil.