I was going through my dropbox and found some of my old notes on information theory, till this day I think I still love these notes. 🙂 I. Introduction to information theory, Information theory: Fundamental Limits of communication Coding Techniques: Concerned with practical techniques to realise the limits specified by information theory Uncertainty:“More the uncertainty of the […]
Hamming code is linear error block code used to encode input. Hamming codes can detect up to two-bit errors or correct one-bit errors without detection of uncorrected errors. Parity Bits in Hamming Code : TestBench: Expected Output 0000 0000000 0001 1101001 0010 0101010 0011 1000011 0100 1001100 0101 0100101 0110 1100110 0111 0001111 1000 1110000 […]
Some believe that by studying scientific discovery in another day we can learn how to make discoveries. On the other hand, one sage observed that we learn nothing from history except that we never learn anything from history and Henry Ford asserted that history is a bunk.
These are book notes for Introduction to Information Theory by John R Pierce and part 1 of this series. Check the tag History of Information Theory for more blogs similar to this. Hear me rambling on and on about Information Theory here and if you want to check out more book summaries do check the […]
Ranjan Bose’s chapter about cyclic codes begins with a riveting quote by Pascal, Blaise “We arrive at the truth, not by reason only, but also by the heart.” Quotes like this make a comprehensive book about information theory even more captivating. Linear Block Codes, block codes –every message m (size k) corresponds to a codeword c (size […]
Everything you’ve come to expect. Mindless, terror-filled panic rushes through me as I open the slides for my exam and can barely understand anything. About a week ago, I was pretty good at most of the things related to the subject, the subject. Yes, Information theory and coding techniques. It was supposed to be my subject […]
1950’s, the age of contemporary mathematics. This was the age when the mathematics in information theory boomed. From Claude Shannon developing the notion of Information theory in 1949 to BCH code being independently invented by three scientists in 1959, the era did see some really significant inputs in that era. ref Fun tangent, quick sort […]