Академический Документы
Профессиональный Документы
Культура Документы
Prof.Dr.
f Muhittin
hi i Gökmen
G k
Dept. Of Computer Eng.
Lecture 1
1) General Informations about course
2) Signals
3) Systems
4) Examples
1
General Information
Course Name:
TEL252E Signals and Systems
Course Staff:
Instructors: Prof.Dr.Muhittin Gökmen
Room #: EEB 4316
e-mail:gokmen@cs.itu.edu.tr
Doç.Dr. Sabih Atadan
Room #:EEB 5109
e-mail: satadan@cs.itu.edu.tr
Teaching Assistant: Muzaffer Ege Alper
R
Room #
#: R
Research
hLLab3
b3
Course Material:
Lecture Notes
Oppenheim, A. V., and A. S. Willsky, with
S. H. Nawab. Signals and Systems. 2nd ed.
New Jersey: Prentice-Hall, 1997.
ISBN: 0138147574.
2
General Information
Evaluation:
4 Homeworks %10
2 Quizes %15
Mid-Term %35
Final %40
Calendar
Week 1 Introduction
Week 2 Continuous-Time and Discrete-Time Signals and Systems. System Properties.
Singular functions.
Week 3 Convolution. Periodic Signals.
Week 4 Continuous- and Discrete-Time Fourier Series.
Week 5 Continuous-Time Fourier Transform.
Week 6 Continuous-Time Fourier Transform (cont.). Discrete-Time Fourier Transform.
Week 7 Discrete-Time Fourier Transform (cont.).
Week 8 First and Second Order Continuous- and Discrete-Time Systems. Ideal and Non-Ideal
Filters.
Week 9 Midterm Exam
Week 10 Sampling. Impulse-Train Sampling. Sampling Theorem and Aliasing. Zero and First
Order Hold. Analog-to-Digital and Digital-to-Analog Conversions.
Week 11 Laplace Transforms
Transforms, Unilateral and Bilateral z-Transforms,
z-Transforms Region of Convergence
(ROC). The relationships between Laplace Transform, (Continuous and Discrete) Fourier
Transforms and z-Transform.
Week 12 Transfer Functions using the Laplace- and z-Transforms, Pole-Zero Plot in s- and z-
planes, Stability.
Week 13 Constant Coefficient Linear Differential and Difference Equations.
Week 14 Block Diagram Representation of Continuous- and Discrete-Time Systems. Direct
Form, Series and Cascade Filter Realizations. Feedback Structure in s-Domain.
3
Course Outline (Tentative)
Fundamental Concepts of Signals and Systems
Signals
Systems
Linear Time-Invariant (LTI) Systems
Convolution integral and sum
Properties of LTI Systems …
Fourier Series
Response to complex exponentials
Harmonically related complex exponentials …
Fourier Integral
Fourier Transform & Properties …
Modulation (An application example)
Discrete-Time Frequency Domain Methods
DT Fourier Series
DT Fourier Transform
Sampling Theorem
Z Transform
Stability analysis in z domain
MG2011 TEL252E Signals and Systems 7
Chapter
p I
Signals and Systems
4
SIGNALS
Signals are functions of independent variables
that carry information about the behavior or
nature of some phenomenon
For example:
• Electrical signals --- voltages and currents
in a circuit
• Acoustic signals --- audio or speech signals
(analog or digital)
• Video signals --- intensity variations in an
image (e.g. a CAT scan)
• Biological signals --- sequence of bases in a
gene
MG2011 TEL252E Signals and Systems 9
What is Signal?
R
+
Vs I
i C Vc
-
RC circuit
5
What is Signal?
Example 2 : Closing value of the stock exchange Example 3:Image as a function of x-y coordinates
index as a function of days (e.g. 256 X 256 pixel image)
Index
M T W T F S S
Fig. Stock exchange
• Can be continuous
— Trajectory of a space shuttle
— Mass
M density
d it iin a cross-section
ti off a brain
b i
•Can be discrete
— DNA base sequence
— Digital image pixels
• Can be 1-D, 2-D, ••• N-D
• For this course: Focus on a single (1-D) independent variable
which we call “time”.
6
CT Signals
DT Signals
• x[n], n — integer, time varies discretely
7
Many human-made DT Signals
Ex.#1 Weekly Dow-Jones Ex.#2 digital image
industrial average
8
Continuous-Time vs. Discrete Time
0 t ... -3 -2 -1 0 1 2 3 4 ... n
(Fig.1.7 Oppenheim)
The signal values may well also be complex numbers (e.g. Phasor of the
capacitor voltage in Example 1 when the input is sinusoidal and R is time
varying)
9
Signal Energy and Power
In many applications, signals are directly related to physical quantities
capturing power and energy in a physical systems
t2
x(t )
2
Total energy of a CT signal x(t ) over t1 t t 2is dt
t1
t
1 2
2
The time average of total energy is x(t ) dtand referred to as
(t2 t1 ) t1
average power of x(t ) over t1 t t 2
n2
x[n]
2
Similarly, total energy of a DT signal x[n] over n1 n nis2
n1
li x(t ) dt x(t )
2 2
E lim d d
dt Total energy in CT signal
T T
N
2 2
E lim x[ n ] x[ n ] Total energy in DT signal
T n N n
In order to define the power over infinite intervals we need to take limit of
the average:
T
1 E Note: Signals with E
T 2T
2
P lim x ( t ) dt lim
T 2T have P 0
T
N
1 E
2
P lim x[ n ] lim
N 2 N 1 N 2 N 1
n N
10
Signal Energy and Power
Neither
et e e energy
e gy nor
o po
power,
e , when
e bot
both E a
and
dPa
are
e infinite
te
e.g: x(t ) e t
Transformation of Independent
Variable
Sometimes we need to change the independent variable
axis for teoretical analysis or for just practical purposes
(both in CT and DT signals)
11
Examples of Transformations
x[n]
Time shift
... ... n
x[n-n0]
........ ... n
n0
Examples of Transformations
x(t)
Time shift
x(t-t0)
t
t0
12
Examples of Transformations
x(t)
Time reversal
x(-t)
Examples of Transformations
Time scaling
x(t)
x(2t)
compressed!
x(t/2)
stretched!
t
13
Examples of Transformations
t
0 1 2
x(t+1)
Let us find x(t+1): 1
Examples of Transformations
t
-1 0 1
x((3/2)t+1)
1
t
-2/3 0 2/3
14
Periodic Signals
A periodic signal satisfies: x(t ) x(t T ) t , T 0
p
Example: A CT p
periodic signal
g
x (t )
2T T
2T
0 T
Periodic Signals
A non-periodic signal is called aperiodic.
Period must be
For DT we must have integer!
15
Even and Odd Signals
If x(t ) x(t ) or x[n] x[n] even signal (symmetric wrt y-axis)
x(t) x(t)
even odd
t t
1
EVx(t ) x(t ) x(t)
2
x(t ) EV x(t ) ODx(t )
1
OD x(t) x(t ) x(t)
2
MG2011 TEL252E Signals and Systems 31
x(t ) Ce
at
C t C
t
MG2011 TEL252E Signals and Systems 32
16
Exponential and Sinusoidal Signals
x(t ) e jw0t
Is this function periodic?
2πn
x(t ) e jw0t e jw0 ( t T ) e jw0t .e jw0T T n Z
ω0
for periodicity =1
e j cos j sin
e j cos j sin
A cos(0t )
2
e
A j (0t ) j (0t )
e
A
e j e j 0 t e j e j 0 t
2
A sin(0t )
2j
e
A j (0t ) j (0t )
e
A j j 0 t
2j
e e e j e j 0 t
Sinusoidals in terms of complex exponentials
MG2011 TEL252E Signals and Systems 34
17
Exponential and Sinusoidal Signals
Alternatively,
A cos((0t ) A Re e j (0t )
A sin( t ) A Ime
0
j (0t )
2
T0
x (t ) 0
CT sinusoidal signal
A cos
A cos(0t )
t
x ( t ) A cos( 0 t )
T T0 T T0
j 0 t 2
E period
T
e dt 1 dt (T T0 ) T T0
T
1
Pperiod E period 1
(T T0 ) T
T 2T
P lim e j t dt 1 IMPORTANT
0
T
18
Harmonically Related Complex
Exponentials
Set of periodic exponentials with fundamental
frequencies that are multiplies of a single
positive frequency 0
k 0 xk (t ) is a constant
k 0 xk (t ) is periodic with fundamental frequency k 0
2 T 2
and fundamental period 0 , where T0
k 0 k 0
19
General Complex Exponential Signals
(Real and imaginary parts) Growing and damping sinusoids for r>0 and r<0
x(t )
t, r 0 t, r 0
x(t ) Ce rt cos(0t )
envelope
MG2011 TEL252E Signals and Systems 39
1 0 1
1 0 1
MG2011 TEL252E Signals and Systems 40
20
DT Sinusoidal Signals
1
General complex exp signals
1
Result:
21
Periodicity Properties of DT Signals
22
Periodicity Properties of DT Signals
23
Periodicity Properties of DT Signals
Examples
OBSERVATION:
With no common factors between N and m, N in (***) is the
fundamental period of the signal
Hence, if we take common factors out
0 1
N 6
2 6
But, if
x(t ) cos 8t
31
and x[n] cos 8n
31
x(t) is periodic with 31/4.
0 4
In DT there can be no fractional periods, for x[n] we have
2 31
then N=31.
Study Fig.1.27 page 27, Table 1.1 in Opp. Example 1.6 as well
MG2011 TEL252E Signals and Systems 48
24
Harmonically Related Complex
Exponentials (Discrete Time)
Set of periodic exponentials with a common period
N
2
Si
Signals
l att frequencies
f i multiples
lti l off
N
(from 0N=2m)
2
jk n
k [n] e N
for k 0 , 1, 2 ,...
25
Unit Impulse and Unit Step Functions
0, n 0 δ[n]
DT unit impulse:
p [n] Unit impulse (unit sample)
1, n 0 - - - - - -
n
u[n]
0, n 0
DT unit step: u[ n ]
1, n 0 - - - - - -
n
Interval of summation
u[ n ] [n - k]
0
[n-k] n<0
- - - - - -
k
n 0
(DT step is the
running sum of DT Interval of summation
unit sample)
[n-k] n>0
- - - - - -
k
n
x[n] [n] x[0] [n] 0
26
Unit Impulse and Unit Step Functions
(Continuous-Time)
0, t 0 u(t)
CT unit step: u(t )
1, t 0 t
δ(t)
CT unit impulse is the
CT impulse: du(t ) 1
(t ) t
1st derivative of the
dt 0 unit sample
t
CT unit step is the running integral
u (t ) ( )d of the unit impulse
Continuous-Time Impulse
(t ) (t )
1/
1
t t
0 0
27
Continuous-Time Impulse
REMARKS:
Signal
g of a unit area
Derivative of unit step function
( ) ( ) d
t1
( 0 ) for t 1 0 t 2
CT and DT Systems
What is a system?
x(t) CT y(t)
System
28
CT and DT Systems
Examples
+ dvc (t ) 1 1
Vs I
i C Vc vc (t ) vs (t )
dt RC RC
-
vc(t): output, vs(t): input
RC circuit
In DT, we have difference equations
Consider a bank account with %1 monthly interest rate
added on: y[n] 1.01y[n 1] x[n]
y[n]: output: account balance at the end of each month
x[n]: input: net deposit (deposits-withdrawals)
MG2011 TEL252E Signals and Systems 57
Interconnection of Systems
Series (or cascade) Connection: y(t) = H2( H1( x(t) ) )
x(t) System 1 System 2 y(t)
H1 H2
29
Interconnection of Systems
System 2
H2
System Properties
Memory vs. Memoryless Systems
An accumulator:
y[n] x[k ]
k
30
System Properties
Invertibility
n t
System Properties
Causality
y (t ) 2 x(t 4) Non-causal
31
System Properties
Stability
Interest system: y[n] 1.01 y[n 1] x[n] unstable (say x[n]=[n], y[n]
grows without bound
System Properties
Time-Invariance
32
System Properties
Linearity
System Properties
Linearity
Examples:
y[n] 2 x[n] 3
y (t ) x 2 (t ) y[n] Re{x[n]}
x1[n] 2, x2 [n] 3
x1[n] r[n] js[ n] y1[n] r[n] x1[n] y1[n] 2.2 3 7
x2 [n] ax1[n] j (r[n] js[ n]) for a j x2 [n] y2 [n] 2.3 3 9
nonlinear
x2 [n] s[n] jr[ n]
x1[n] x2 [n] 2 3 5
x2 [n] y2 [ n] s[ n] ay1[n]
x1[n] x2 [n] y1 2 [n] 2.5 3 13
y1[n] y2 [ n] 7 9 16 y1 2 [n]
nonlinear
nonlinear
y[n] 2 x[n 1]
linear
MG2011 TEL252E Signals and Systems 66
33
Superposition in LTI Systems
Exercise: Given response y(t) of an LTI system to the input signal x(t) below,
find response of that system to the input signals x1(t) and x2(t) shown below.
x(t)
() y(t)
2
1
t t
1 -1 1
x1(t) x2(t) 4
2
2
1 3 t
t
-1
-1/2 1/2 1
MG2011 TEL252E Signals and Systems 68
34
3
Audio Physics Of Acoustics
Sound can be thought of in one of two ways:
• In the time domain
• In the frequency domain
• Transformation
T f ti is
i accomplished
li h d by
b a Fourier
F i transform
t f
Fourier:
• Any waveform can be represented by a sum of sine waves
3
Physics Of Acoustics con’t
Audio
• I0 tthreshold
es o d (just pe
perceived) ( 0-12 Jou
ce ved) (10 Joule/s
e/s . m²),
), OdB
Od
• +10 dB (double loudness) equals 10-fold energy
35
3
Audio Physics Of Acoustics con’t
Frequency Pitch
Amplitude Loudness
3
Analog to Digital: Theory of Sampling
Audio
36
3 Analog to Digital: Theory of Sampling con’t
Sampling rate determined by properties of recorded sound:
Audio
3
Audio Quality of Common Appliances
Audio
37
3
Audio Sampling Rates
3
Common Coding Methods
Audio
38
3
Audio Physics Of Acoustics con’t
Frequency Pitch
Amplitude Loudness
3 Example
Audio
Phonem: Stairs
Di h
Diphon
Half syllable
Syllable
39
3 Speech Synthesis in Frequency Domain
Audio
3 Speech Input
Audio
40
3 Speech Recognition
Audio
Sound pattern
Word model
3
Sound Enhancement
Audio
• Declicking
• Noise Reduction
• Echo suppression
41
3
Audio Declicking
3
Declicking con’t
Audio
42
3
Audio Noise Reduction
3
Echo Suppression
Audio
sonogram
43
Baseline JPEG Encoder Block Diagram
44
Baseline JPEG Pros and Cons
• Advantages • Disadvantages
• Memory Efficient • Single resolution
• Low complexity • Single quality
• Compression efficiency • No target bit rate
• Visual model utilization • No lossless capability
• Robustness • No tiling
• No ROI
• Blocking artifacts
• Poor error resilience
45
MG2011 TEL252E Signals and Systems 91
Zooming
46
1 1 1 1 1 1 1 1 1
1 1 1 1 1 1 1 1 1
1 1 1 1 1 1 1 1 1
1 1 1 1 1 1 1 1 1
* 1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
=
1 1 1 1 1 1 1 1 1
1 1 1 1 1 1 1 1 1
1 1 1 1 1 1 1 1 1
Median Operation
9 65
8 63
7 62
61 621 59
1 651 6 60
62 59 65
57 601 63 561 rank 59
1 60 63 56 5
59 551 58
1 571 4 58
55 58 57
49 53 55 45 3 57
2 56
C1,2= 59 55
1
MG2011 TEL252E Signals and Systems 94
47
9x9 Median
Edge Detection
What is an edge
A large
l change
h iin iimage b
brightness
i ht off a short
h t
spatial distance
Edge strength = (I(x,y)-I(x+dx,y))/dx
48
Roberts Operator
I ( x , y ) I ( x 1 , y 1 ) I ( x , y 1 ) I ( x 1 , y )
2 2
or
I ( x , y ) I ( x 1, y 1 ) I ( x , y 1 ) I ( x 1, y )
1 0 0 1
0 -1 + -1 0
Prewitt Operator
-1 -1 -1 -1 0 1
P1= 0 0 0 P2 -1 0 1
1 1 1 = -1 0 1
P
Edge Direction = tan 1 1
P2
49
Robinson Compass Masks
-1 0 1 0 1 2 1 2 1 2 1 0
-2 0 2 -1 0 1 0 0 0 1 0 -1
-1 0 1 -2 -1 0 -1 -2 -1 0 -1 -2
1 0 -1 0 -1 -2 -1 -2 -1 -2 -1 0
2 0 -2 -1 0 -1 0 0 0 -1 0 1
1 1 -1 2 1 0 1 2 1 0 1 2
0 1 2
-1 0 1
-2 -1 0
1 2 1
0 0 0
-1 -2 -1
50
2D Laplacian Operator
2 f x, y 2 f x, y
f ( x, y )
2
x 2
y 2
0 -1 0 1 -2 1 -1 -1 -1
-1 4 -1 -2 4 -2 -1 8 -1
0 -1 0 1 -2 1 -1 -1 -1
0 -1 0
-1 4 -1
0 -1 0
51
Chapter 4
Image Enhancement in the
Frequency Domain
Chapter 4
Image Enhancement in the
Frequency Domain
52
Chapter 3
Image Enhancement in the
Spatial Domain
Chapter 3
Image Enhancement in the
Spatial Domain
53