ECE: Electrical & Computer Engineering

ECE 5634 Information Theory


Fall 2014 textbook list

The Fall 2014 ECE textbook list is available online for students.

Current Prerequisites & Course Offering

For current prerequisites for a particular course, and to view course offerings for a particular semester, see the Virginia Tech Course Timetables.

Return to course list

ECE 5634 Information Theory (3C)

Transmission of information over noisy channels. Measures of information and transmission channel capacity. Use of codes to improve the reliability of such transmission. Mathematical theory of information. Transmission at rates above channel capacity. Includes linear codes, error detecting and correcting codes, Hamming codes.

What is the reason for this course?

Electrical engineering graduate students who wish to pursue research or careers in the data communications field require the course to understand the performance limits of this field. Communications research also requires a basic knowledge of data transmission through noise channels.

Typically offered: Spring. Program Area: Communications.

Prerequisites: Prerequisites: 4634, 5605, STAT 4714.

Why are these prerequisites or corequisites required?

This course sequence requires a basic understanding of probability theory, stochastic processes and digital communication theory. The probability theory may be obtained in STAT 4714, the stochastic processes may be obtained in 5605, and the digital communication theory may be obtained in 4634.

Department Syllabus Information:

Major Measurable Learning Objectives:
  • measure information quantitatively.
  • Understand how data sequences can be compressed.
  • Determine limits on maximum compression.
  • understand how information can be reliably transmitted over a noisy channel.
  • Analyze the capacity of noisy communication channels.

Course Topics
Topic Percentage
Probability of Error and Information Measurement 15%
Channel Capacity, Kraft Inequality 10%
Data Compaction, Entropy, Markov Sources, Shannon’s Theorem 10%
Error and performance Channel Bounds 10%
Noisy Channels, Mutual Information, Capacity of Discrete Noisy Channels 20%
Continuous Channels 20%
Estimation Theory 15%

Return to course list