Академический Документы
Профессиональный Документы
Культура Документы
February 2009
1/58
Introduction
The main objective of a communication system is the transfer
of information over a channel.
Message signal is best modeled by a random signal: Any
signal that conveys information must have some uncertainty in
it, otherwise its transmission is of no interest.
Two types of imperfections in a communication channel:
Deterministic imperfection, such as linear and nonlinear
distortions, inter-symbol interference, etc.
Nondeterministic imperfection, such as addition of noise,
interference, multipath fading, etc.
2/58
3/58
4/58
5/58
Conditional Probability
We observe or are told that event E1 has occurred but are
actually interested in event E2 : Knowledge that of E1 has
occurred changes the probability of E2 occurring.
If it was P (E2 ) before, it now becomes P (E2 |E1 ), the
probability of E2 occurring given that event E1 has occurred.
This conditional probability is given by
P (E2 E1 )
, if P (E1 ) 6= 0
P (E2 |E1 ) =
.
P (E1 )
0,
otherwise
If P (E2 |E1 ) = P (E2 ), or P (E2 E1 ) = P (E1 )P (E2 ), then
E1 and E2 are said to be statistically independent.
Bayes rule
P (E1 |E2 )P (E2 )
P (E2 |E1 ) =
,
P (E1 )
A First Course in Digital Communications
6/58
n
[
Ei =
(1a)
i=1
n
X
P (Ei )P (A|Ei ).
i=1
Bayes rule:
P (Ei |A) =
A First Course in Digital Communications
P (A|Ei )P (Ei )
P (A|Ei )P (Ei )
= Pn
.
P (A)
j=1 P (A|Ej )P (Ej )
7/58
Random Variables
x(4 )
x(1 )
x(3 )
x(2 )
8/58
9/58
1.0
(a)
10/58
(b)
0
Fx ( x )
1.0
(c)
11/58
2. fx (x)dx = 1.
R
3. In general, P (x A) = A fx (x)dx.
12/58
Fx ( x )
1
1 p
(1 p )
( p)
13/58
0.15
0.10
0.05
x
0
14/58
Fx ( x )
1
1
ba
x
a
x
a
15/58
Fx ( x )
1
2 2
1
1
2
x
0
16/58
X
i
f (x )
x i ,
dg(x)
dx x=xi
17/58
18/58
19/58
20/58
0.4
0.2
0
0.2
0.4
0.6
0.8
0
0.2
0.4
0.6
0.8
t (sec)
21/58
3.5
fx(x) (1/volts)
3
2.5
2
1.5
1
0.5
0
1
0.5
0
x (volts)
0.5
fx (x)
fx (x)
x)
1
(xm
2
2x
p
e
(Gaussian)
2x2
a a|x|
e
(Laplacian)
2
22/58
0.35
=5
x
0.3
fx(x)
0.25
0.2
0.15
0.1
0.05
0
15
10
Range (kx )
P (mx kx < x mx kx )
Error probability
Distance from the mean
A First Course in Digital Communications
0
x
k=1
0.683
103
3.09
10
k=2
0.955
104
3.72
15
k=3
0.997
106
4.75
k=4
0.999
108
5.61
23/58
2 Fx,y (x, y)
.
xy
24/58
Z
fx,y (x, y)dy = fx (x).
Note that:
Z Z
25/58
fx,y (x, y)
, fx (x) 6= 0
fy (y|x) =
.
fx (x)
0,
otherwise
26/58
(correlation)
(covariance).
27/58
cov{x, y}
.
x y
28/58
29/58
Example 1
x {1, 0, 1} with probabilities {1/4, 1/2, 1/4}
y = x3 {1, 0, 1} with probabilities {1/4, 1/2, 1/4}
z = x2 {0, 1} with probabilities {1/2, 1/2}
my = (1) 14 + (0) 12 + (1) 14 = 0; mz = (0) 12 + (1) 12 = 12 .
The joint pmf (similar to pdf) of y and z:
1
2
1
4
1
4
P (y = 1, z = 0) = 0
P (y = 1, z = 1) = P (x = 1) = 1/4
P (y = 0, z = 0) = P (x = 0) = 1/2
P (y = 0, z = 1) = 0
0
P (y = 1, z = 0) = 0
P (y = 1, z = 1) = P (x = 1) = 1/4
=0
30/58
1
q
1 2x,y
exp
1
2(1 2x,y )
(x mx )2 2x,y (x mx )(y my ) (y my )2
+
x2
x y
y2
,
31/58
x,y=0
0.15
2.5
fx,y(x,y)
0.1
1
0.05
0
0
1
2
0
2
y
3
2
2.5
0
x
32/58
=0.30
x,y
a crosssection
0.15
2.5
fx,y(x,y)
0.1
1
0.05
0
0
1
2
0
2
y
3
2
2.5
0
x
33/58
=0.70
x,y
0.2
2.5
2
a crosssection
0.1
0.05
fx,y(x,y)
0.15
0
1
2
0
2
y
3
2
2.5
0
x
34/58
x,y=0.95
0.5
2.5
0.4
fx,y(x,y)
0.3
1
0.2
y
0.1
0
1
2
0
2
y
3
2
2.5
0
x
35/58
Define
x = [x1 , x2 , . . . , xn ], a vector of the means
1
(2)n
det(C)
1
exp ( x m)C ( x m)
.
2
36/58
Random Processes I
1
M
2
Real number
x(t,)
x(tk,)
x1(t,1)
x2(t,2)
xM(t,M)
...
.
.
.
.
.
.
.
.
.
.
.
.
Time
37/58
Random Processes II
Ensemble: The set of possible time functions that one sees.
Denote this set by x(t), where the time functions x1 (t, 1 ),
x2 (t, 2 ), x3 (t, 3 ), . . . are specific members of the ensemble.
At any time instant, t = tk , we have random variable x(tk ).
At any two time instants, say t1 and t2 , we have two different
random variables x(t1 ) and x(t2 ).
Any relationship between them is described by the joint pdf
fx(t1 ),x(t2 ) (x1 , x2 ; t1 , t2 ).
A complete description of the random process is determined by
the joint pdf fx(t1 ),x(t2 ),...,x(tN ) (x1 , x2 , . . . , xN ; t1 , t2 , . . . , tN ).
The most important joint pdfs are the first-order pdf
fx(t) (x; t) and the second-order pdf fx(t1 )x(t2 ) (x1 , x2 ; t1 , t2 ).
38/58
39/58
Tb
40/58
= t2 t1 .
41/58
x1 =
xN =
kN
xN fx(t1 ),x(t2 ),...x(tN ) (x1 , x2 , . . . , xN ; t1 , t2 , . . . , tN )
42/58
The average is across the ensemble and if the pdf varies with
time then the mean value is a (deterministic) function of time.
If the process is stationary then the mean is independent of t
or a constant:
Z
mx = E{x(t)} =
xfx (x)dx.
43/58
x2 fx (x)dx (stationary).
44/58
Correlation
The autocorrelation function completely describes the power
spectral density of the random process.
Defined as the correlation between the two random variables
x1 = x(t1 ) and x2 = x(t2 ):
Rx (t1 , t2 ) = E{x(t1 )x(t2 )}
Z
Z
=
x1 x2 fx1 ,x2 (x1 , x2 ; t1 , t2 )dx1 dx2 .
x1 =
x2 =
x2 =
45/58
46/58
Timedomain ensemble
x (t, )
1
f
0
x (t, )
2
|X (f, )|
x (t, )
M
.
.
.
.
.
.
.
.
.
|X (f, )|
M
.
.
.
A First Course in Digital Communications
47/58
(watts).
48/58
Z T
1
= lim
E x2T (t) dt
T 2T T
n
o
Z
E |XT (f )|2
=
lim
df
2T
T
(watts).
49/58
Finally,
Sx (f ) = lim
n
o
E |XT (f )|2
2T
(watts/Hz),
50/58
1
= lim
T 2T
51/58
52/58
Input
x(t )
Linear, Time-Invariant
(LTI) System
h(t )
H( f )
Output
y (t )
Rx , y ( )
my , Ry ( )
Sy ( f )
mx , Rx ( )
Sx ( f )
my = E{y(t)} = E
Z
h()x(t )d = mx H(0)
Sy (f ) = |H(f )|2 Sx (f )
Ry ( ) = h( ) h( ) Rx ( ).
A First Course in Digital Communications
53/58
Rw ( ) = kG
Sw (f ) =
54/58
N0/2
0
15
White noise
Thermal noise
10
0
f (GHz)
10
15
(b) Autocorrelation, R ()
w
Rw() (watts)
N0/2()
0.1
White noise
Thermal noise
0.08 0.06 0.04 0.02
0
0.02
(picosec)
0.04
0.06
0.08
0.1
55/58
N0
(watts/Hz),
2
where N0 = 4kG is a constant.
Noise that has a uniform spectrum over the entire frequency
range is referred to as white noise
The autocorrelation of white noise is
N0
Rw ( ) =
( ) (watts).
2
Since Rw ( ) = 0 for 6= 0, any two different samples of
white noise, no matter how close in time they are taken, are
uncorrelated.
Since the noise samples of white noise are uncorrelated, if the
noise is both white and Gaussian (for example, thermal noise)
then the noise samples are also independent.
Sw (f ) =
56/58
Example
Suppose that a (WSS) white noise process, x(t), of zero-mean and
power spectral density N0 /2 is applied to the input of the filter.
(a) Find and sketch the power spectral density and
autocorrelation function of the random process y(t) at the
output of the filter.
(b) What are the mean and variance of the output process y(t)?
L
x(t )
y (t )
57/58
H(f ) =
Sy (f ) =
N0
2 1+
R
1
=
.
R + j2f L
1 + j2f L/R
1
2L 2
R
f2
Ry ( ) =
N0 R (R/L)| |
e
.
4L
Ry ( ) (watts)
S y ( f ) (watts/Hz)
N0
2
N0R
4L
f (Hz)
(sec)
58/58