ENSC 424 - Multimedia Communications
Engineering
Lecture
Notes are in SFU Canvas Page.
____________________________________________________________________________________
Course Description
The objective
of this course is to provide students with important
background
in
the engineering aspects of multimedia communications. We will address how to efficiently
compress multimedia data, including image, video, speech, and audio,
and how to
deliver
them over a variety of networks. In the coding aspect, basic
compression technologies will be covered. A
number of compression standards, such as JPEG, MPEG,
H.263, MP3, JPEG 2000 and
video coding standard H.264 and HEVC will be
analyzed. In the networking
aspect, the architectures
and protocols associated with
multimedia
communications networks will be introduced. These include TCP/IP,
UDP, and RTP/RTCP. Special
considerations for multimedia transmission, such as synchronization,
quality of service, and error resilience, will
be covered.
The best way to understand and
appreciate an algorithm
is to program it. Therefore, this course emphasizes computer
assignments
and projects. Students will be graded on a combination
of assignments, tests and the final project.
Prerequisites
ENSC 380 is a prerequisite for ENSC 424. In addition, a course like
ENSC 327 would be an asset. Students should
be familiar with the following concepts:
- Fourier transforms
- Random variables, including probability density functions and
expectation
- Correlation and stationarity
- Linear algebra and matrix notation;
- Discrete-time signal processing techniques such as sampling
and filtering
Besides, programming in MATLAB and C/C++
will be involved throughout this course.
Mailing List
The course will have a mailing list ensc-424@sfu.ca, which you will be
able
to use to send
time-critical announcements to everyone in the class.
Plagiarism Issues:
Please review the following page on plagiarism when you work on your
project:
http://www.lib.sfu.ca/help/writing/plagiarism
Pay attention to the following forms of plagiarism:
- Quoting material without proper use of quotation
marks (even if otherwise cited appropriately)
- Using art, graphs, illustrations, maps,
statistics, photographs, etc. without complete and proper citation
- Paraphrasing or summarizing information from a
source without proper acknowledgment
You should state clearly in your report whether you have used any
source code from other people, and what modification you have made to
improve it, if any.
As in any other course, anyone caught cheating on the project report
will receive an automatic F.
The Text Books
There is no required textbook. The lecture notes are self-contained. Notes will be posted online and
links/handouts on various topics may be provided.
The main reference is:
Other references:- Z.-N. Li, M. S. Drew, J. Liu, Fundamentals of Multimedia, 2nd Edition, 2014.
- K. S. Thyagarajan, Still iamge and video compression with Matlab, Wiley, 2011. (pdf version available at SFU library website)
- David S. Taubman,
Michael W. Marcellin, JPEG2000:
image compression fundamentals,
standards, and practice, Kluwer Academic Publishers, Boston,
2002.
- K. R. Rao and P.C. Yip, The Transform and Data Compression Handbook, Boca Raton, CRC Press LLC, 2001.
- Yun
Q. Shi, Huifang Sun, Image and Video Compression for Multimedia
Engineering: Fundamentals, Algorithms, and Standards, CRC
Press,2008.
Syllabus
The following is a brief synopsis of what will be covered in this
course. Note that this material is still evolving.
- Multimedia signals
- Transform
- Wavelet transform
- Lapped transform
- Quantization
- Uniform quantization
- Lloyd-Max quantization
- Entropy Coding
- Huffman Coding
- Golumb-Rice Coding
- Arithmetic coding
- EZW, SPIHT and EBCOT in JPEG 2000
- CAVLC and CABAC in H.264
- Image coding standards
- Video coding and standards
- Motion estimation/compensation
- MPEG
- H.264
- HEVC
- SVC
- MVC