l'EacuteITIRechercheNouvellesReacutepertoiresRessourcesGeacutenie/EngineeringUd'O/UofOSITESearchNewsDirectoriesResourcesSITE

ELG 5170 (92.551) Information Theory

Measure of information: entropy, relative entropy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; Data compression: Huffmann code. arithmetic coding; Channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, coloured Gaussian noise and "water-filling"; Rate distortion theory; Network information theory

Course Outline

Assignment 1
Assignment 2
Assignment 3
Assignment 4

Term papers

Contactez: L'École d'ingénierie et de technologie de l'information /
Contact: School of Information Technology and Engineering
Copyright © 2001 Université d'Ottawa / University of Ottawa
Webmestre / Webmaster