CSE445

Multimedia Engineering
Dr. Michael Melek

1
 Course Outline
• Introduction to multimedia
• Representation and compression of
‒ Images
‒ Video
‒ Audio
• Voice over IP, video over IP

2
 References
• “Multimedia Systems: Algorithms, Standards,
and Industry Practices,” Parag Havaldar, Gerard
Medioni, 1st Edition

• “Fundamentals of Multimedia,” Ze-Nian Li, Mark

S. Drew, Jiangchuan Liu, 2nd Edition

• Online lectures

3
 Grading System
• 60% Coursework
‒ 25% midterm
‒ 5% attendance
‒ 10% quizzes
‒ 20% labs and projects

• 40% final exam

4
 Multimedia
Content that uses a combination of:
• Text
• Audio
• Images
• Video
• Animations
in a meaningful way to convey some information

5
Application 1 — Education/Business
Corporate presentations may
combine text, audio, images,
animation and video

6
Application 2 — Engineering
Virtual reality uses
multimedia content, e.g.,
military or industrial training

7
Application 3 — Video Game

a combination of text, audio,

still image, animation, video,
and interactivity content
forms

8
 Multimedia examples
• Browsing internet
• Playing video games
• Video conferencing
• Presentations
• Watching TV, movies
• Online courses
• Virtual reality, augmented reality

9
 Properties of Multimedia Data
1. Digital
2. Large size
3. Interactive (usually)

10
 Signal
• A signal is a physical phenomenon that varies
with one or more independent variable (time,
space, …)
• Examples:
Voltage, speech, temperature, light intensity, …
• Sound, images, videos are signals

11
 Media Types
1. Audio
Speech, music, or any sound

• 1D signal (function of time)

12
 1. Audio
CD Quality Audio is sampled at 44.1 KHz
(sample/sec), each sample is stored in 16 bits.
1 minute of Mono CD quality uncompressed
audio requires:
44100 × 2 × 60 ≈ 5MB
1 minute of Stereo CD quality uncompressed
audio requires 10 MB
• Audio is usually compressed (e.g. MP3, AAC, …)

13
 2. Images
A two-dimensional array
of pixels

• Example
Grayscale image (1 byte per pixel
representing gray level)
• Image is a 2D signal (2 space dimensions)

14
 2. Images
• Find the size of a color image of size 1000x1000
pixels, assuming a pixel is stored in 3 bytes. A
pixel is stored in 3 bytes representing R,G,B
𝑆𝑖𝑧𝑒 = 3000000 𝑏𝑦𝑡𝑒𝑠 = 3𝑀𝐵
for an uncompressed image
• Compression is commonly applied (e.g. JPEG,
JPEG-2000)

15
 3. Video
A sequence of images

• Video is a 3D signal
(2 space dimensions
and 1 time dimension)

16
 3. Video
• Find the size of a color video of resolution
1280 × 720 at a frame rate of 30 fps of
duration 2 hours.
1280 × 720 × 3 × 30 × 60 × 60 × 2 ≈ 597 𝐺𝐵
for an uncompressed video
• Videos are always compressed (e.g. MPEG-1,
MPEG-2, MPEG-4, …)

17
 4. Text
Characters that are used to create words,
sentences, and paragraphs

18
 5. Animations
A sequence of graphics that create an illusion of
motion.

19
Multimedia system

20
 Reasons of growth of Multimedia
1. Digitization of most devices
2. Better hardware performance and processing
speeds
3. New compression algorithms
4. Evolution of communications and data
networks
5. Smarter user interfaces (e.g. touch screens)

21
 Challenges in a multimedia system
1. Bandwidth limitations
2. Real-time processing requirements
3. Inter-media synchronization
4. End-to-end delays
5. Multimedia indexing and retrieval

22