ELG5126 Source Coding and Data Compression

Announcements

Lectures will start on Thursday, September 6.
Prerequisite: Basic probability and signal processing as typically obtained in an undergraduate Electrical Engineering program (e.g., at uOttawa, ELG3125 Signal and System Analysis, and ELG3126 Random Signals and Systems) .
If the midterm mark is less than 14/20, and the final mark is greater than the midterm mark, then the midterm mark will be replaced by the final mark or 14/20, whichever is lower: IF (MIDTERM < 14) AND (FINAL > MIDTERM) THEN NEWMIDTERM = MIN(FINAL,14)

These notes were originally typed by students who took the course in 2011. I have edited them, but I welcome your suggestions and corrections.

Lossless coding of discrete-alphabet sources (updated 2012-10-26, note correction in the first line of pg. 38)

Khalid Sayood, Introduction to Data Compression, third edition, Morgan Kaufmann, 2006. E-book on Science Direct, available on University of Ottawa campus network.
Companion website (software)

Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, second edition, Wiley, 2006. E-book on ebrary, available on University of Ottawa campus network.
Alberto Leon-Garcia, Probability, Statistics, and Random Processes for Electrical Engineering, third edition, Pearson, 2008. uOttawa library catalog record.
Allen Gersho and Robert M. Gray, Vector Quantization and Signal Compression, Springer (formerly Kluwer), 1992. Description on Springer website.
N.S. Jayant and Peter Noll, Digital Coding of Waveforms: Principles and Applications to Speech and Video, Prentice-Hall, 1984. uOttawa library catalog record.

Term project description
Presentations will be Monday, December 17, Sports Complex, room SCS E218.
Presentation schedule.
All students are expected to attend all presentations. Attendance will be noted.
Presentation guidelines: Presentations should be at most 12 minutes. Those who have not completed after 12 minutes will be asked to go to their conclusion slide and wrap up. The presentation should include an introduction to the problem or application area, a summary of the techniques used in the project, a description of the implementation or tools used, and a survey of results obtained to date. The conclusion should summarize what was done and what was learned. Only minimal mathematical developments (if any) will be possible in this time. The presentation will be assessed on these elements and effective use of time and visuals. Running out of time will be penalized, so please rehearse.
The last date to submit the report without penalty is Friday, Dec. 21.