Information Theory and Coding

IIT Bombay Course , Prof. S.N.Merchant

43 students enrolled

Overview

Introduction to Information Theory and Coding - Definition of Information Measure and Entropy - Extension of An Information Source and Markov Source - Adjoint of An Information Source, Joint and Conditional Information Measures - Properties of Joint and Conditional Information Measures and a Markov Source - Asymptotic Properties of Entropy and Problem Solving in Entropy - Block Code and Its Properties - Instantaneous Code and Its Properties - Kraft-Mcmillan Equality and Compact Codes - Shannon's First Theorem - Coding Strategies and Introduction to Huffman Coding - Huffman Coding and Proof of Its Optimality - Competitive Optimality of The Shannon Code - Non-Binary Huffman Code and Other Codes - Adaptive Huffman Coding - Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding


Introduction to Information Channel - Equivocation and Mutual Information - Properties of Different Information Channels - Reduction of Information Channels - Properties of Mutual Information and Introduction to Channel Capacity - Calculation of Channel Capacity for Different Information Channel - Shannon's Second Theorem - Discussion on Error Free Communication Over Noisy Channel - Error Free Communication Over a Binary Symmetric Channel - Differential Entropy and Evaluation of Mutual Information - Channel Capacity of a Bandlimited Continuous Channel - Introduction to Rate-Distortion Theory - Definition and Properties of Rate-Distortion Functions - Calculation of Rate-Distortion Functions - Computational Approach For Calculation of Rate-Distortion Functions - Introduction to Quantization - Lloyd-Max Quantizer - Companded Quantization - Variable Length Coding and Problem Solving In Quantizer Design - Vector Quantization - Transform - Transform Coding

Lecture 1: Introduction to Information Theory and Coding

Up Next
You can skip ad in
SKIP AD >
Advertisement
      • 2x
      • 1.5x
      • 1x
      • 0.5x
      • 0.25x
        EMBED LINK
        COPY
        DIRECT LINK
        PRIVATE CONTENT
        OK
        Enter password to view
        Please enter valid password!
        0:00
        3.2 (17 Ratings)

        Lecture Details

        Information Theory and Coding by Prof. S.N.Merchant, Department of Electrical Engineering, IIT Bombay. For more details on NPTEL visit httpnptel.iitm.ac.in


        LECTURES




        Review


        3.2

        17 Rates
        5
        29%
        5
        4
        24%
        4
        3
        12%
        2
        2
        12%
        2
        1
        24%
        4

        Comments Added Successfully!
        Please Enter Comments
        Please Enter CAPTCHA
        Invalid CAPTCHA
        Please Login and Submit Your Comment

        LECTURES