Академический Документы
Профессиональный Документы
Культура Документы
Chapter 3
Information Theory
A message is a sequence of Symbol intended to reduce Uncertainty of Receiver. If a sequence of symbol does not change the Uncertainty Level of the receiver, the message does not contain any information.
@Samrat Subedi 4
@Samrat Subedi
@Samrat Subedi
Therefore
The Information content of any message signal is closely related to
The past knowledge of Occurrence of event
and
Level of uncertainty it contains with respect to the recipients of the message
Thus in general
The amount of information received from knowledge of Occurrence of an event is related to the probability or the likelihood of Occurrence of the Event.
@Samrat Subedi 7
Measurement
Let m1,m2,m3mq be out of a possible message emitted by a source with probabilities p1,p2,pq Such that p1+p2++pq=1 If I(mk) is the information Content of Kth message Then,
1. 2. 3. 4. 5. I(mk) > I(mj) for pk <pj I(mk) 0 for pk 1 I(mk) 1 for pk 0 I(mk) 0 for 0 pk 1 I(mkand mj) = I(mk)+ I(mj)
@Samrat Subedi 8
To Satisfy above Condition We can Relate I(mk) and pk I(mk) = log (1/pk)
Entropy
The average information content of a sequence of symbol Consider a memory less source( i.e. probability of
Occurrence of symbol does not depend upon previous and future Occurrence of Symbol
P(si) = piN
And the information Content
piNlog2(1/pi)
i =1
@Samrat Subedi
11
H=
piNlog2(1/pi) bits/Symbol
i =1
@Samrat Subedi
12
Baseband Digital Communication System It refers to a system in which tx and Rx of digital Signal over a band limited channel without carrier modulation. Since baseband Signal have sizable power at low frequency, they are suitable for transmission over a pair of cable, coaxial cable, optical fiber etc. Before Transmission some transformation in data waveform is needed.
@Samrat Subedi 13
@Samrat Subedi 14
The output of pulse generator is x(t) = bk Pg(t- KTb) k =- Where Pg(t) is a basic Pulse whose amplitude bK depends upon the input data Sequence
@Samrat Subedi
15
The signal from pulse generator is then passed through Tx filter, Rx filter, The channel with noise added at channel. So the output of Receiver filter is x(t) = Kc bk Pg(t- KTb-d) no(t) K = Where,
y(t) is then passed through decision making device. If y(t) is above threshold output is 1 else 0.
k =
@Samrat Subedi 17
Pg(t- KTb)
k m
The first Term is mth decoded bit and the second term represents the residue while decoding mth bit due to all other transmitted bit called ISI
@Samrat Subedi 18
Design Criteria
ISI arises due to dispersion of pulse shape by the filter and channel. The major task of System Designer is to optimally design transmitting and receiving filter and the shape of basic pulse to minimize ISI. Parameter Known to Designer
Input Bit Stream Channel Characteristics Statistical Characteristics of Noise
@Samrat Subedi 19
Selection Of Optimum
HT(f) Hc(f) Pg(t)
Criteria
Maximize data rate Optimize Bandwidth Minimum Error Rate Minimum Transmission Power Maximize SNR Simple Circuit Design
@Samrat Subedi 20
Band Limited pulse can not be time limited. Pulse amplitude can be detected correctly despite pulse spreading if there is no ISI at the decision making Instant This can be accomplished by properly shaped band limited Pulse
@Samrat Subedi 22
k = k m
P (mT - KT )
r b b
Pr [(m- K)Tb] = 1 =0
@Samrat Subedi
k=m k=m
24
@Samrat Subedi
25
Tb
2Tb
@Samrat Subedi 26
Transmission of Rb bits/Sec require a minimum bandwidth of Rb/2 Hz. The Pulse satisfying Nyquist criteria and has B/W of Rb/2 Hz is
Sin(2Bot ) p(t) = sinc (2B0t) = (2Bot )
1/2B0
f
B0 p(t) decreases too slowly at the -B0 Rate of 1/t. If the nominal data rate of Rb bits/sec required for this scheme deviates a little, the pulse amplitude will not vanish at other pulse centre. The Cumulative interference at any pulse centre from all the remaining pulse will @Samrat Subedi be very high. 28
0
29
For
@Samrat Subedi
30
2B0P(f)
p(t)
1
-Tb
0
@Samrat Subedi
Tb
31
P(t) 1
@Samrat Subedi
32
Characteristics of p(f)
For = 0, it is ideal case For = 0.5 & 1 p(f) cut off gradually and hence it is physically implementable Value of p(f) at f/B0 =1 will be half of its maximum value for any P(f) is real i.e. non negative
@Samrat Subedi
33
Characteristics of p(t)
At t= Tb/2, p(t) has half amplitude for =1 additional zero crossing at +3Tb/2, +5Tb/2 in addition to Tb, 2Tb,. These are used for generating timing signal for Synchronization.
@Samrat Subedi
34
Transmission Bandwidth Consideration B/WPAM = B0 (B0= 1/2Tb) Ideal Case For Raised Cosine We have = 1 f1/B0 B= 2B0- f1 = 2B0 B0(1- ) For =1 B/W = 2B0 In general B/WPAM =B0(1+ @Samrat Rb/2(1+ ) ) = Subedi 35
@Samrat Subedi
36
Correlative-Level Coding
For Rb data Rate, the absolute min B/W as per Nyquist Criteria is Rb/2 and with raised Cosine minimum bandwidth is Rb. By adding ISI to the transmitted signal in a controlled manner, it is possible to achieve a signaling rate equal to the Nyquist rate of 2W symbols/sec in a channel of bandwidth W Hz. Correlative-level coding may be regarded as a practical method of achieving the theoretical maximum signaling rate of 2 W symbols/sec in a bandwidth of W Hz
@Samrat Subedi 37
Data Rate
Bandwidth
Rb Rb Rb
Correlative Coding
@Samrat Subedi
38
DUOBINARY CODING
Duobinary signaling implies doubling the transmission
capacity in a straight binary system. This particular form of correlative-level coding is also called class I partial response. Consider a binary input sequence {bk} applied to a pulseamplitude modulator to produce a two-level sequence {ak} :
+A if symbol bk is 1 ak = { -A if symbol bk is 0 When this sequence is applied to a duobinary encoder, it is converted into a three-level@Samrat Subedi output, namely, -2A, 0, and +2A. 39
We may express the duobinary coder output ck as the sum of the present input pulse ak and its previous value ak-1, as shown by
ck = ak + ak-1
@Samrat Subedi
40
+2A
Ck =
0
-2A
And We have
HI(f) = HNyquist(f) . HDB(f)
For Tb seconds delay element having frequency response exp(-j2fTb), the frequency response of the delay-line is 1 + exp(-j2fTb)
@Samrat Subedi 41
The overall frequency response of the duobinary signaling scheme has the form of a half-cycle cosine function, as 2cos(fTb) exp(-jfTb) HI(f) = 0 otherwise |f| < 1/2Tb (=B0)
AND
@Samrat Subedi
43
Frequency response of the duobinary conversion filter. (a) Magnitude response. (b) Phase response.
@Samrat Subedi 44
If ck is received without error and if the previous estimate ak-1 corresponds to a correct decision, then the current estimate ak will be correct too. A major drawback of this detection procedure is that once errors are made, they tend to propagate through the output because a decision on the current ak depends on the correctness of the decision made on the previous ak-1. @Samrat Subedi 45
A means to avoid the error-propagation is to use precoding before the duobinary coding
The precoding operation performed on the binary data sequence {bk} converts it into another binary sequence {dk} defined by
dk = bk dk-1 Ck = dk + dk-1
+A dk = { -A
If it is 1 If it is 0
@Samrat Subedi 46
dK
If kth input bit bk=0 Then dk=dk-1 So if bk =0 Ck = +2A or -2A if bk =1 bk is complement of bk-1 ck=0
0 ck =
if data symbol bk is 1
47
@Samrat Subedi
+ 2A if data symbol bk is 0
@Samrat Subedi
48
Take an Example
Input bit Sequence {bk} 0 1 (let) +A 1 0 1 1 0 0 0 1 1 0 1
dk
Representation of dk Output of DB Encoder{ck=dk+dk-1} Decoded Bit
+A
+A
-A 0 1
-A -2A 0
+A +A 0 1 +2 A 0
+2A +2A 0
Put dk-1 =0 and do again
@Samrat Subedi
49
MODIFIED DUOBINARY SIGNALING If we observe the frequency response of duobinary signalling, we see that it has non zero frequency response at t=0 This is not Suitable for circuitary with no DC path. Hence we use Modified DB.
@Samrat Subedi
50
The overall frequency response of the delay-line filter connected with an ideal Nyquist channel, as in Figure 4.16, is given by
HIV(f) = HNyquist(f) [l - exp(-j4fTb)] = 2j HNyquist(f) sin(2fTb) exp(-j2fTb) 2jsin(2fTb) exp(-j2fTb), HIV(f) = { 0, elsewhere |f| < 1/2Tb
@Samrat Subedi
51
@Samrat Subedi
52
In a baseband M-ary PAM system, the pulse-amplitude modulator produces one of M possible amplitude levels with M > 2.
A signal alphabet in M-ary PAM system contains M equally likely and statistically independent symbols, with symbol duration T seconds. The signaling rate 1/T is expressed in symbols per second, or bauds. This form of pulse modulation is illustrated in Figure 4.20a for the case of quaternary (M = 4) system and the binary data sequence 0010110111.
@Samrat Subedi
53
@Samrat Subedi
54
Signaling Rate and B/W Requirement: Let Rs(Symbol per sec or Baud) be the Symbol rate emitted by the source If M symbols are emitted that are equiprobable and spastically independent
Entropy (H) =
p log (1/p )
i =1
i 2 i
And Information Rate(Rinfo) =Rs x H Rslog2M bps Absolute B/W requiredSubediRs/2 --------<1> 55 is @Samrat
From Equation 1 & 2 we see B/W requirement for Mary and binary system is same
@Samrat Subedi 56
Eye Diagram/ Eye Pattern When the Sequence is transmitted over a baseband binary data transmission system, the signal obtained at the output Yr(t) is a continuous time signal
1 0 1 1 0 1 Resultant Channel Output Waveform
Tb
2Tb
3Tb
4Tb
5Tb
@Samrat Subedi
57
If the received Signal is cut in each interval Tb and place over one another, the diagram obtained is known as eye Diagram as it looks like an eye.
Tb
Data 0
Tb
Tb
Tb
Tb
Tb
Tb
Tb
@Samrat Subedi
58
If the received Signal is cut in each interval Tb and place over one another, the diagram obtained is known as eye Diagram as it looks like an eye.
This pattern can also be obtained on CRO if Yr(t) is applied to vertical input and a saw tooth signal with duration T=Tb @Samrat Subedi 59 at horizontal input
@Samrat Subedi
60