Information Theory and Source coding

I was going through my dropbox and found some of my old notes on information theory, till this day I think I still love these notes. 🙂 I. Introduction to information theory, Information theory: Fundamental Limits of communication Coding Techniques: Concerned with practical techniques to realise the limits specified by information theory Uncertainty:“More the uncertainty of the […]

Verilog : Hamming Code On FPGA

Hamming code is linear error block code used to encode input. Hamming codes can detect up to two-bit errors or correct one-bit errors without detection of uncorrected errors. Parity Bits in Hamming Code :  TestBench:  Expected Output 0000 0000000 0001 1101001 0010 0101010 0011 1000011 0100 1001100 0101 0100101 0110 1100110 0111 0001111 1000 1110000 […]

Information Theory, Coding and Cryptography.

Ranjan Bose’s chapter about cyclic codes begins with a riveting quote by Pascal, Blaise “We arrive at the truth, not by reason only, but also by the heart.” Quotes like this make a comprehensive book about information theory even more captivating. Linear Block Codes, block codes –every message m (size k) corresponds to a codeword c (size […]

Information Theory: Channel Coding, Channel Capacity.

Everything you’ve come to expect. Mindless, terror-filled panic rushes through me as I open the slides for my exam and can barely understand anything. About a week ago, I was pretty good at most of the things related to the subject, the subject. Yes, Information theory and coding techniques. It was supposed to be my subject […]

BCH code. Bose–Chaudhuri–Hocquenghem codes.

1950’s, the age of contemporary mathematics. This was the age when the mathematics in information theory boomed. From Claude Shannon developing the notion of Information theory in 1949 to BCH code being independently invented by three scientists in 1959, the era did see some really significant inputs in that era. ref Fun tangent, quick sort […]