Universitatea Babeş-Bolyai Cluj-Napoca
Facultatea de Matematică şi Informatică
Ciclul de studii: Licenţă
Domeniul: Calculatoare şi tehnologia informaţiei
Programul de studii: Ingineria informatiei - in limba engleza
Limba de predare: Engleză

SYLLABUS

I. General data
Code	Subject	
MIC0013	Multimedia Applications over the Web	

Semester	Hours: C+S+L+P	Category	Status	
6	2+0+1+1	speciality	optional	

II. Full status faculty members
Name and	Scientific	Didactic	Chair	Type of activity	
surname	title	title		C	S	L	
COBARZAN Claudiu	Ph.D.	Lect.	Computer Systems	*			

Associated faculty members
Name and	Scientific	Institution	Type of	Type of activity	
surname	title		position	C	S	L	

III. Course objectives

Provide an introduction to multimedia and multimedia support on the web. Familiarize the students with the main audio-video formats and codecs. Provide basic information on multimedia streaming. Introduce W3C standards intended to provide multimedia support on the web. Present main APIs in high-level programming languages supporting multimedia applications development. Provide information on the use of multimedia metadata and on the management and protection of intellectual property rights. 

IV. Course contents

1. Introduction into multimedia
2. Audio-video formats, video codecs 
    2.1 MPEG-1, 2, 4 (DivX, XVid, FFMpeg, VideoLan)
    2.2 H.264
3. Streaming and signaling protocols 
    3.1 RTP/RTCP - Real Time Protocol
    3.2 RTSP - Real Time Streaming Protocol
    3.3 SDP - Session Description Protocol
    3.4 SIP - Session Initiation Protocol
4. Audio-Video Players
    4.1 FFMpeg mplayer
    4.2 VLC - VideoLan player
5. W3C standards for multimedia support
    5.1 HTML support for multimedia
    5.2 SMIL - Synchronized Multimedia Integration Language
    5.3 VoiceXML
    5.4 SSML - Speech Synthesis Markup Language
6. Multimedia presentations on the web
    6.1 SMIL presentations 
    6.2 Adobe FLASH
    6.3 Action Script
7. Multimedia Metadata - MPEG-7
8. Multimedia Proxy-Caches
9. Multimedia support in high-level programming languages 
    9.1 JMF - Java Media Framework 
    9.2 .NET framework support
10. IPMP (Intellectual Propriety Management and Protection, MPEG-21) 

V. Bibliography

1. Ian S. Burnett (Editor), Fernando Pereira (Editor), Rik Van de Walle (Editor), Rob Koenen (Editor), The MPEG-21 Book, Wiley, 2006, ISBN: 978-0-470-01011-2
2. Mohammed Ghanbari, Standard Codecs: Image Compression to Advanced Video Coding, IEE, 2003, ISBN: 0-85296-710-1, 978-0-85296-710-2
3. Harald Kosch , Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21, CRC Press, ISBN: 978-0-8493-1854-2, 978-0-203-00933-8
4. B. S. Manjunath (Editor), Philippe Salembier (Editor), Thomas Sikora (Editor), Introduction to MPEG-7: Multimedia Content Description Interface, Wiley, 2002, ISBN: 978-0-471-48678-7Provide 
5. Fernando C. Pereira, Touradj Ebrahimi, The MPEG-4 Book, Prentice Hall PTR, 2002, ISBN:0130616214
6. Colin Perkins, RTP - Audio and Video for the Internet, Addison-Wesley, 2003, ISBN 0-672-32249-8 
7. Iain Richardson, Video Codec Design: Developing Image and Video Compression Systems, Wiley, 2002, ISBN: 978-0-471-48553-7
8. ***, World Wide Web Consortium (www.w3c.org)
9. ***, MPEG home page (www.chiariglione.org/mpeg/) 

VI. Thematic of didactic activities per weeks

Course (2 hours per week):
Week 1: 1. Introduction to multimedia. Analog and digital representation of audio and video signals.   The JPEG compression standard.
Week 2: 2. Audio-video formats (containers) and codecs.
                  Basics of video encoding. The structure of a general video encoder/decoder. AV encoding
                  standards. AV containers.
Week 3: 2. Audio-video formats (containers) and codecs. The MPEG-1 and MPEG-2 standards.
Week 4: 2. Audio-video formats (containers) and codecs. The H.264/MPEG-4 AVC standard. H.264/MPEG-4 SVC.
Week 5: 3. Multimedia streaming protocols. RTP and RTCP. 
Week 6: 3. Multimedia signaling protocols. RTSP, SDP, SIP.  
Week 7: 4. Audio-Video players. Analysis of open source implementations: FFMpeg mplayer, VLC.
Week 8: 5. W3C standards for multimedia support: HTML, SMIL, VoiceXML, SSML.
Week 9: 6. Multimedia presentations on the web: SMIL presentations.
Week 10: 6. Multimedia presentations on the web: Adobe FLASH, ActionScript.
Week 11: 7. Multimedia Metadata: the MPEG-7 standard.
Week 12: 8. Intermediate entities on the web: multimedia proxy-caches. Requirements. Design. Functionalities.
Week 13: 9. Multimedia support in high-level programming languages. The Java (JMF – Java Media Framework) vs. the .NET approach.
Week 14: 10. Intellectual Propriety Management and Protection (IPMP). The MPEG-21 standard.

Laboratory (1 hour per week):
Week 1-3: Image processing. JPEG encoder in java
Week 4: Using the SDL library (displaying a BMP/YUV image on a SDL surface). Examples in C/C++.
Week 5-8: Introduction to the FFMPEG library. Writing a simple audio-video player based on FFMPEG and SDL (written in C). Audio-video synchronization. Saving frames as images.
Week 9-10: Java sound processing.
Week 11: W3C standards for multimedia support. Simple HTML, SMIL, VoiceXML and SSML examples. 
Week 12-14: Multimedia presentations: writing a simple SMIL player; creating Adobe FLASH presentations; writing simple ActionScript programs.

Project (1 hour per week):
Week 1-2: Administrative issues, discussions about project ideas, evaluation, examples.
Week 3-4: Presentation of project themes. Students have to form teams of up to 3 participants and choose a project theme. For the current year the teams and their projects can be found at http://www.cs.ubbcluj.ro/~claudiu/en/projects.html 
Week 5-13: Team-based/individual project work, questions, ideas and talks. The teams have to present periodically their progress on the project. The final grade reflects not only the final state of a project but also its progress during the semester. Projects shown only at the final presentation will not be graded with 10. 
Week 14: Public presentation of team-based/individual projects and reports.

VII. Didactic methods used

Didactic methods used: description, explanation, lecture with demonstrations, talks, computer demonstrations, guided and independent rediscovery, individual study.

VIII. Assessment

The final mark will be computed as a weighted mean as follows: 60% evaluation of a personal/team web based software application, 40% evaluation of a short paper presenting technical aspects of the implemented software solution. 

IX. Additional references

	Dean,							Chair head,

	Date,							Course responsible,
								Lect. COBARZAN Claudiu, Ph.D.