## SEE: Guide to Download NPTEL Video Lecture

## Lecture Details :

Information Theory and Coding by Prof. S.N.Merchant, Department of Electrical Engineering, IIT Bombay. For more details on NPTEL visit http://nptel.iitm.ac.in

## Course Description :

Contents:

Introduction to Information Theory and Coding - Definition of Information Measure and Entropy - Extension of An Information Source and Markov Source - Adjoint of An Information Source, Joint and Conditional Information Measures - Properties of Joint and Conditional Information Measures and a Markov Source - Asymptotic Properties of Entropy and Problem Solving in Entropy - Block Code and Its Properties - Instantaneous Code and Its Properties

Kraft-Mcmillan Equality and Compact Codes - Shannon's First Theorem - Coding Strategies and Introduction to Huffman Coding - Huffman Coding and Proof of Its Optimality - Competitive Optimality of The Shannon Code - Non-Binary Huffman Code and Other Codes - Adaptive Huffman Coding - Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding

Introduction to Information Channel - Equivocation and Mutual Information - Properties of Different Information Channels - Reduction of Information Channels - Properties of Mutual Information and Introduction to Channel Capacity - Calculation of Channel Capacity for Different Information Channel - Shannon's Second Theorem - Discussion on Error Free Communication Over Noisy Channel - Error Free Communication Over a Binary Symmetric Channel - Differential Entropy and Evaluation of Mutual Information - Channel Capacity of a Bandlimited Continuous Channel - Introduction to Rate-Distortion Theory

Definition and Properties of Rate-Distortion Functions - Calculation of Rate-Distortion Functions - Computational Approach For Calculation of Rate-Distortion Functions - Introduction to Quantization - Lloyd-Max Quantizer - Companded Quantization - Variable Length Coding and Problem Solving In Quantizer Design - Vector Quantization - Transform - Transform Coding

## Other Resources :

### Citation |

The above video lectures are presented by IITBombay, India, under the program NPTEL, there are more than 130+ NPTEL courses Online available.

## Other Electrical Engineering Courses

- Digital Circuits and Systems by IIT Madras
- Intelligent Systems and Control by IIT Kanpur
- FPGA Verilog student projects by Cornell University
- Power System Dynamics and Control by IIT Bombay
- Microelectronic Devices and Circuits,Fall 2011 by UC Berkeley
- MATLAB by IIT Kharagpur
- Dynamics of Physical System by IIT Kharagpur
- Analog Integrated Circuit Design by IIT Madras
- Introduction to Digital Integrated Circuits,Spring 2011 by UC Berkeley
- Introduction to MEMS Design,Fall 2011 by UC Berkeley

### » check out the complete list of Electrical Engineering Video lectures