{"id":315,"date":"2021-08-07T16:55:27","date_gmt":"2021-08-07T16:55:27","guid":{"rendered":"https:\/\/itgeeks.in\/home\/?p=315"},"modified":"2021-08-07T16:55:29","modified_gmt":"2021-08-07T16:55:29","slug":"2k6-ec-703-information-theory-and-coding","status":"publish","type":"post","link":"https:\/\/itgeeks.in\/home\/?p=315","title":{"rendered":"2K6 EC 703: INFORMATION THEORY AND CODING"},"content":{"rendered":"\n<p><strong>Module 1 (14 hours)<\/strong><br>Information theory: &#8211; Concept of amount of information \u2013units &#8211; Entropy -marginal, conditional and joint entropies &#8211; relation among entropies &#8211; Mutual information &#8211; information rate-channel capacity- redundancy and efficiency of channels. Binary memoryless source &#8211; extension of a binary memoryless source \u2013Markov sorce \u2013Entropy -losslesssource coding- Uniquely decodable codes- Instantaneous codes- Kraft\u2019s inequality &#8211; Optimal codes- Huffman code-Shannon\u2019s Source Coding Theorem &#8211; Lempel-Ziv coding \u2013 Channel coding theorem<br><strong>Module 2 (8 hours)<\/strong><br>Introduction to algebra &#8211; groups &#8211; fields &#8211; binary field arithmetic &#8211; construction of Galois field Basic properties &#8211; computations &#8211; vector spaces &#8211; matrices<br><strong>Module 3 (18 hours)<\/strong><br>Codes for error detection and correction: &#8211; Parity check coding, Linear block codes, Error detecting and correcting capabilities, Generator and Parity check matrices, Standard array and Syndrome decoding, Hamming codes, Encoding and decoding of systematic and unsystematic codes. Cyclic codes: &#8211; Generator polynomial, Generator and Parity checkmatrices, Encoding of cyclic codes, Syndrome computation and error detection, Decoding of cyclic codes. BCH codesdescription-decoding-Reed Solomon codes<br><strong>Module 4 (12 hours)<\/strong><br>Convolution codes &#8211; encoder &#8211; generator matrix &#8211; state diagram \u2013 distance properties &#8211; maximum likelihood decoding &#8211; viterbi decoding &#8211; sequential decoding &#8211; Burst error correction \u2013 interleaved codes-Turbo coding- Turbo decoding<\/p>\n\n\n\n<p><strong>Text Books<\/strong><br>1. Norman Abramson, Information Theory, John Wiley<br>2.\u00a0<a href=\"https:\/\/itgeeks.in\/home\/?p=318\">Shu Lin, Costello D.J., Error Control Coding &#8211; Fundamentals and applications, Prentice<\/a><br>3.<a href=\"https:\/\/itgeeks.in\/home\/?p=316\">\u00a0Simon Haykin, Digital Communications, John Wiley<\/a><br>4.<a href=\"https:\/\/itgeeks.in\/home\/?p=320\">\u00a0Taub &amp; Schilling, Principles of Communication System, Tata McGraw Hill<\/a><br><strong>Reference books<\/strong><br>1.\u00a0<a href=\"https:\/\/itgeeks.in\/home\/?p=312\">Tomasi, Electronic Communication, Fundamentals Through Advanced, Pearson education<\/a><br>2.\u00a0<a href=\"https:\/\/itgeeks.in\/home\/?p=322\" data-type=\"URL\">Sklar, Digital Communication, Pearson Education<\/a><br>3.\u00a0<a href=\"https:\/\/itgeeks.in\/home\/?p=324\">T. Cover and Thomas, \u201cElements of Information Theory\u201d, John Wiley &amp; Sons<\/a><\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"https:\/\/itgeeks.in\/home\/?p=202\">S7 Question Papers<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"https:\/\/itgeeks.in\/home\/?p=285\">Notes<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Module 1 (14 hours)Information theory: &#8211; Concept of amount of information \u2013units &#8211; Entropy -marginal, conditional and joint entropies &#8211;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28,22,9,8],"tags":[7],"class_list":["post-315","post","type-post","status-publish","format-standard","hentry","category-ku-s7-ece","category-ku-syb-s7","category-ku-syllabus","category-syllabus","tag-kannur-university"],"_links":{"self":[{"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/posts\/315","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=315"}],"version-history":[{"count":1,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/posts\/315\/revisions"}],"predecessor-version":[{"id":326,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=\/wp\/v2\/posts\/315\/revisions\/326"}],"wp:attachment":[{"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=315"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=315"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itgeeks.in\/home\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=315"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}