2K6 EC 703: INFORMATION THEORY AND CODING

Module 1 (14 hours)
Information theory: – Concept of amount of information –units – Entropy -marginal, conditional and joint entropies – relation among entropies – Mutual information – information rate-channel capacity- redundancy and efficiency of channels. Binary memoryless source – extension of a binary memoryless source –Markov sorce –Entropy -losslesssource coding- Uniquely decodable codes- Instantaneous codes- Kraft’s inequality – Optimal codes- Huffman code-Shannon’s Source Coding Theorem – Lempel-Ziv coding – Channel coding theorem
Module 2 (8 hours)
Introduction to algebra – groups – fields – binary field arithmetic – construction of Galois field Basic properties – computations – vector spaces – matrices
Module 3 (18 hours)
Codes for error detection and correction: – Parity check coding, Linear block codes, Error detecting and correcting capabilities, Generator and Parity check matrices, Standard array and Syndrome decoding, Hamming codes, Encoding and decoding of systematic and unsystematic codes. Cyclic codes: – Generator polynomial, Generator and Parity checkmatrices, Encoding of cyclic codes, Syndrome computation and error detection, Decoding of cyclic codes. BCH codesdescription-decoding-Reed Solomon codes
Module 4 (12 hours)
Convolution codes – encoder – generator matrix – state diagram – distance properties – maximum likelihood decoding – viterbi decoding – sequential decoding – Burst error correction – interleaved codes-Turbo coding- Turbo decoding

Text Books
1. Norman Abramson, Information Theory, John Wiley
2. Shu Lin, Costello D.J., Error Control Coding – Fundamentals and applications, Prentice
3. Simon Haykin, Digital Communications, John Wiley
4. Taub & Schilling, Principles of Communication System, Tata McGraw Hill
Reference books
1. Tomasi, Electronic Communication, Fundamentals Through Advanced, Pearson education
2. Sklar, Digital Communication, Pearson Education
3. T. Cover and Thomas, “Elements of Information Theory”, John Wiley & Sons