Contents
- Announcements
- Documents
- Course Notes
- Lecture Slides
- References
- Term Project
- Assignments
- MATLAB
- Midterm Exam
- Final Exam
Announcements
- Lectures will start on Thursday, September 6.
- Prerequisite: Basic probability and signal processing as typically obtained in an undergraduate Electrical Engineering program (e.g., at uOttawa, ELG3125 Signal and System Analysis, and ELG3126 Random Signals and Systems) .
- If the midterm mark is less than 14/20, and the final mark is greater than the midterm mark, then the midterm mark will be replaced by the final mark or 14/20, whichever is lower: IF (MIDTERM < 14) AND (FINAL > MIDTERM) THEN NEWMIDTERM = MIN(FINAL,14)
Documents
- Course outline
- P. Kabal, Minimum Mean Square Error Quantizers, May 1980.
Course notes
These notes were originally typed by students who took the course in 2011. I have edited them, but I welcome your suggestions and corrections.
- Lossless coding of discrete-alphabet sources (updated 2012-10-26, note correction in the first line of pg. 38)
Lecture Slides
- Introduction
- Huffman Coding
- Golomb Codes
- Arithmetic Coding
- Quantization (Updated 2012-11-08)
- Rate Allocation/ Transform Coding (updated 2012-11-27)
- Course summary
References
Textbook
- Khalid Sayood, Introduction to Data Compression, third edition, Morgan Kaufmann, 2006. E-book on Science Direct, available on University of Ottawa campus network.
- Companion website (software)
Other references
- Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, second edition, Wiley, 2006. E-book on ebrary, available on University of Ottawa campus network.
- Alberto Leon-Garcia, Probability, Statistics, and Random Processes for Electrical Engineering, third edition, Pearson, 2008. uOttawa library catalog record.
- Allen Gersho and Robert M. Gray, Vector Quantization and Signal Compression, Springer (formerly Kluwer), 1992. Description on Springer website.
- N.S. Jayant and Peter Noll, Digital Coding of Waveforms: Principles and Applications to Speech and Video, Prentice-Hall, 1984. uOttawa library catalog record.
Term Project
- Term project description
- Presentations will be Monday, December 17, Sports Complex, room SCS E218.
- Presentation schedule.
- All students are expected to attend all presentations. Attendance will be noted.
- Presentation guidelines: Presentations should be at most 12 minutes. Those who have not completed after 12 minutes will be asked to go to their conclusion slide and wrap up. The presentation should include an introduction to the problem or application area, a summary of the techniques used in the project, a description of the implementation or tools used, and a survey of results obtained to date. The conclusion should summarize what was done and what was learned. Only minimal mathematical developments (if any) will be possible in this time. The presentation will be assessed on these elements and effective use of time and visuals. Running out of time will be penalized, so please rehearse.
- The last date to submit the report without penalty is Friday, Dec. 21.
Assignments
- Assignment 1, due October 18, 2012. Solution
- Assignment 2, due November 22, 2012. Solution
- Assignment 3, 2011, with solution
Matlab
- Mathworks Home Page
- Bonnie Heck’s Matlab tutorial
- m-file to generate a Huffman code
- m-file to generate a block Huffman code
Midterm Exam
- 80 minutes. Closed book.
- Midterm exam 2012. Solution
- Midterm exam 2011 with answers
- Midterm exam, 2000. Solution
- Formulas, 2000.
Final Exam
- Three hours, Dec. 11, 2012, 9:00-12:00, Colonel By Hall, room CBY D103.
- Closed-book exam
- Final exam, 2011 Answers
- Formulas, 2011
- Final exam, 2000
- Formulas, 2000