Академический Документы
Профессиональный Документы
Культура Документы
S
N
A
H
IT
Prepared by
H
AT
S ATHITHAN
Assistant Professor
F
O
Department of of Mathematics
Faculty of Engineering and Technology
S
TE
SRM UNIVERSITY
Kattankulathur-603203, Kancheepuram District.
O
N
E
R
TU
C
LE
SRM UNIVERSITY
3 Mathematical Expectation 5
S
3.1 Properties of Expectation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
N
3.2 Variance and its properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
A
4 Moments and Moment Generating Function 6
H
4.1 Moments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
IT
4.2 Moment Generating Function (MGF) . . . . . . . . . . . . . . . . . . . . . . 8
H
5 Example Worked out Problems 10
AT
6 Exercise/Practice/Assignment Problems 33
F
O
S
TE
O
N
E
R
TU
C
LE
Page 1 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Unit-1
Probability and Random Variables
T OPICS :
? Probability Concepts and Problems
? Random Variables (Discrete and Continuous)
? General Probability Distributions and Problems
? Moments and Moment Generating Functions
S
N
A
H
IT
H
AT
F
O
S
TE
O
N
E
R
TU
C
LE
Page 2 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
1 Probability
An Experiment whose outcome or result can be predicted with certainty is called a deterministic
experiment.
An Experiment whose all possible outcomes may be known in advance, the outcome of a
particular performance of the experiment cannot be predicted owing to a number of unknown
S
cases is called a random experiment.
N
Definition 1.1 (Sample Space). Set of all possible outcomes which are assumed to be equally
likely is called the sample space and is usually denoted by S. Any subset A of S containing
A
favorable outcomes is called an event.
H
IT
1.1.2 The Approaches to Define the Probability
H
AT
Definition 1.2 (Mathematical or Apriori Definition of Probability). Let S be a sample space and
A be an event associated with a random experiment. Let n(S) and n(A) be the number of elements
F
of S and A. Then the probability of event A occurring, denoted by P(A) and defined as
O
be repeated n times and let an event A occur n1 times out of n trials. The ratio is called
n
N
n1
the relative frequency of the event A. As n increases, shows a tendency to stabilize and to
n
approach a constant value and is denoted by P(A) is called the probability of the event A. i.e.,
E
R
n1
P (A) = lim
TU
n→∞ n
be an event associated with a random experiment. Then the probability of the event A is denoted
LE
Theorem 1. The probability of the impossible event is zero. i.e., if φ is a subset of S containing
no event, then P (φ) = 0.
Page 3 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
The above Theorem can be extended for 3 events which is given by P (A ∪ B ∪ C) = P (A) +
P (B) + P (C) − P (A ∩ B) − P (B ∩ C) − P (C ∩ A) + P (A ∩ B ∩ C)
S
N
A
1.2 Conditional Probability and Independents Events
H
IT
The conditional probability of an event B, assuming that the event A has happened, is denoted
by P (B/A) and is defined as
H
P (B/A) =
P (A ∩ B)
AT
, provided P (A) 6= 0
P (A)
F
O
There are few properties for the conditional distribution. Please go through it in the textbook.
E
When two events A and B are independent, we have P (B/A) = P (B) and the Product
R
Theorem takes the form P (A ∩ B) = P (A) · P (B). The converse of this statement is also. i.e.,
TU
This result can be extended to any number of events. i.e., If A1 , A2 , . . . , An be n no. of events,
LE
then
P (A1 ∩ A2 ∩ A3 ∩ · · · ∩ An ) = P (A1 ) · P (A2 ) · P (A3 ) · · · · P (An )
Theorem 6. If the events A and B are independent, then the events A and B (and similarly A
and B, A and B) are also independent.
Page 4 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
S
N
P (Bi )P (A/Bi )
P (Bi /A) = P
n , i = 1, 2, . . . , n
A
P (Bi )P (A/Bi )
H
i=1
IT
H
2 Discrete and Continuous Distributions AT
For the problems on Discrete and Continuous Random Variables(RV’s) we have to note down
F
Discrete ] RV Continuous ] RV
TE
Z
Operator Σ
N
E
CDF∗ F (X = x) = P (X ≤ x) F (X = x) = P (X ≤ x)
LE
∞
X Z∞
Total Probability P (X = x) = 1 f (x)dx = 1
−∞ −∞
]
RV-Random Variable, *CDF-Cumulative Distribution Function or Distribution Function
3 Mathematical Expectation
Definition 3.1 (Expectation). An average of a probability distribution of a random variable X
is called the expectation or the expected value or mathematical expectation of X and is denoted
Page 5 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
by E(X).
Definition 3.2 (Expectation for Discrete Random Variable). Let X be a discrete random vari-
able taking values x1 , x2 , x3 , . . . with probabilities P (X = x1 ) = p(x1 ), P (X = x2 ) =
X∞
p(x2 ), P (X = x3 ) = p(x3 ), . . . , the expected value of X is defined as E(X) = xi p(xi ),
i=−∞
if the right hand side sum exists.
Definition 3.3 (Expectation for Continuous Random Variable). Let X be a continuous ran-
dom variable with pdf f (x) defined in (−∞, ∞), then the expected value of X is defined as
Z∞
E(X) = xf (x)dx.
S
−∞
Note: E(X) is called the mean of the distribution or mean of X and is denoted by X or µ.
N
A
H
3.1 Properties of Expectation
IT
1. If c is any constant, then E(c) = c.
H
AT
2. If a, b are constants, then E(aX + b) = aE(X) + b.
3. If (X, Y ) is two dimensional random variable, then E(X + Y ) = E(X) + E(Y ).
F
Definition 3.4. Let X be a random variable with mean E(X), then the variance of X is defined
N
Properties of Variance
TU
1. V ar(aX) = a2 V ar(X)
C
2. V ar(aX ± b) = a2 V ar(X).
LE
4.1 Moments
Definition 4.1 (Moments about origin). The rth moment of a random variable X about the
origin is defined as E(X r ) and is denoted by µ0r . Moments about origin are known as raw
moments.
Page 6 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Note:By moments we mean the moments about origin or raw moments.
The first four moments about the origin are given by
1. µ01 = E(X)=Mean
2. µ02 = E(X 2 )
3. µ03 = E(X 3 )
4. µ04 = E(X 4 )
2
Note: V ar(X) = E(X 2 ) − [E(X)]2 = µ02 − µ01 =Second moment - square of the first moment.
Definition 4.2 (Moments about mean or Central moments). The rth moment of a random variable
S
X about the mean µ is defined as E[(X − µ)r ] and is denoted by µr .
N
The first four moments about the mean are given by
A
H
1. µ1 = E(X − µ) = E(X) − E(µ) = µ − µ = 0
IT
2. µ2 = E[(X − µ)2 ] = V ar(X)
H
3. µ3 = E[(X − µ)3 ] AT
4. µ4 = E[(X − µ)4 ]
Definition 4.3 (Moments about any point a). The rth moment of a random variable X about
F
Relation between moments about the mean and moments about any arbitrary point a
C
Let µr be the rth moment about mean and m0r be the rth moment about any point a. Let µ be the
LE
mean of X.
Page 7 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
∴ µr = E[(X − µ)r ]
= E[(X − a) − (µ − a)]r
= E[(X − a) − m01 ]r
E (X − a)r − r C1 (X − a)r−1 m01 + r C2 (X − a)r−2 (m01 )2 − · · · + (−1)r (m01 )r
=
= E(X − a)r − r C1 E(X − a)r−1 m01 + r C2 E(X − a)r−2 (m01 )2
−r C3 E(X − a)r−3 (m01 )3 + r C4 E(X − a)r−4 (m01 )4 − · · · + (−1)r (m01 )r
= m0r − r C1 m0r−1 m01 + r C2 m0r−2 (m01 )2 − r C3 m0r−3 (m01 )3 + r C4 m0r−4 (m01 )4
− · · · + (−1)r (m01 )r
S
N
We define(fix) m00 = 1, then we have
A
H
µ1 = m01 − m00 m01 = 0
IT
µ2 = m02 − 2 C1 m01 · m01 + (m01 )2
= m02 − (m01 )2
H
AT
µ3 = m03 − 3 C1 m02 · m01 + 3 C2 m01 · (m01 )2 − (m01 )3 ·
= m03 − 3m02 · m01 + 2(m01 )3
µ4 = m04 − 4 C1 m03 · m01 + 4 C2 m02 · (m01 )2 − 4 C3 m01 · (m01 )3 + (m01 )4 ·
F
O
Definition 4.4 (Moment Generating Function (MGF)). The moment generating function of a
random variable X is defined as E(etX ) for allt ∈ (−∞, ∞). It is denoted by M (t) or MX (t).
E
R
n
TU
X
etx P (X = x) if X is discrete
x=0
C
MX (t) = E(etX ) =
LE
Z∞
etx f (x)dx if X is continuous
x=0
Page 8 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
i.e.
∴ MX (t) generates all the moments about the origin. (That is why we call it as Moment
S
Generating Function (MGF)).
N
Another phenomenon which we often use to find the moments is given below:
A
H
(r)
µ0r = MX (0)
IT
H
We have
t 0 (t)2 0
AT
(t)3 0 (t)r 0
MX (t) = E(etX ) = 1 + µ1 + µ2 + µ3 + · · · + µ + ...
1! 2! 3! r! r
F
O
(t)2 0 (t)r−1 0
MX0 (t) = µ01 + tµ02 + µ3 + · · · + µ + ...
(r − 1)! r
O
2!
N
(t)2 0 (t)r−2 0
MX00 (t) = µ02 + tµ03 + µ4 + · · · + µ + ...
2! (r − 2)! r
E
...
R
(r)
MX (t) = µ0r + terms of higher powers of t
TU
..
.
C
LE
Putting t = 0, we get
The Maclaurin’s series expansion given below will give all the moments.
t 0 t2 00
MX (t) = MX (0) + MX (0) + MX (0) + . . .
1! 2!
Page 9 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
The MGF of X about its mean µ is MX−µ (t) = E et(X−µ) .
Properties of MGF
S
4. If X and Y are independent RV’s then, MX+Y (t) = MX (t) · MY (t).
N
A
5 Example Worked out Problems
H
IT
Example: 1. From 6 positive and 8 negative numbers, 4 are chosen at random(without replace-
H
ment) and multiplied. What is the probability that the product is negative?
AT
Hints/Solution: If the product is negative(-ve), any one number is -ve (or) any 3 numbers are
-ve.
F
1001 1001
E
R
TU
Example: 2. A box contains 6 bad and 4 good apples. Two are drawn out from the box at a time.
One of them is tested and found to be good. What is the probability that the other one is also
C
good.
LE
Hints/Solution: Let A be an event of first drawn apple is good and let B be an event that the
other one is also good.
4
P (A ∩ B) C2 /10 C2 6/45 1
∴ The required probability is P (B/A) = = 4 = =
P (A) 10
4/10 3
4
Aliter: Probability of the first drawn apple is good= .
10
Once the first apple is drawn, the box contains only 9 apples in total and 3 good apples.
3 1
∴ Probability of the second drawn apple is also good= = .
9 3
Page 10 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Example: 3. The chances of A, B and C become the general manager of a certain firm is in the
ratio 4:2:3. The probabilities that the bonus scheme will be introduced in the company if A, B
and C become general manager is 0.3, 0.7 and 0.8 respectively. Find the probability that the
bonus scheme is introduced. If the bonus scheme has been introduced, what is the probability
that B has been appointed as general manager?.
Hints/Solution: Let B be an event of the bonus scheme is introduced. Let A1 , A2 , A3 be the
event of A, B, C becoming the general manager respectively.
4 2 3
Given, P (A1 ) = , P (A2 ) = , P (A3 ) = and
9 9 9
3 7 8
P (B/A1 ) = 0.3 = , P (B/A2 ) = 0.7 = , P (B/A3 ) = 0.8 =
10 10 10
S
∴ By Total Probability Theorem and Bayes’ Theorem, the required probabilities are
N
n
12 14 24 50
A
X
P (B) = P (Ai )P (B/Ai ) = + + =
90 90 90 90
H
i=1
IT
and
P (A2 )P (B/A2 ) 14/90 14
P (A2 /B) = P = =
H
n
50/90 50
P (Ai )P (B/Ai ) AT
i=1
F
O
Example: 4. A bag contains 5 balls and if it not known that how many of them are white. Two
S
balls are drawn at random from the bag and they are noted to be white. What is the probability
TE
that the bag contains at least 2 white balls and all the balls in the bag are white?
O
Hints/Solution: Let B be an event that two balls are drawn, they turns to be white. i.e., the
N
bag contains at least 2 white balls. Let A1 , A2 , A3 , A4 be the event that the bag contains 2,3,4,5
white balls respectively. Here we may imagine that there are 4 different bags with 2w,3w,4w,5w
E
balls. If we choose the bag that may be any one of these bags, so all the events A1 , A2 , A3 , A4
R
1 1 1 1
∴ P (A1 ) = , P (A2 ) = , P (A3 ) = , P (A4 ) = and
C
4 4 4 4
LE
2 3
C2 1 C2 3
P (B/A1 ) = 5 = , P (B/A2 ) = 5 = ,
C2 10 C2 10
4 5
C2 6 C2
P (B/A3 ) = 5 = , P (B/A4 ) = 5 = 1.
C2 10 C2
∴ By Total Probability Theorem and Bayes’ Theorem, the required probabilities are
n
X 1 1 3 6 10 1
P (B) = P (Ai )P (B/Ai ) = + + + =
i=1
4 10 10 10 10 2
and
P (A2 )P (B/A2 ) 1/4 1
P (A2 /B) = P
n = =
1/2 2
P (Ai )P (B/Ai )
i=1
Page 11 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Example: 5. 1% of women at age forty who participate in routine screening have breast cancer.
80% of women with breast cancer will get positive mammographies. 9.6% of women without
breast cancer will also get positive mammographies. A woman in this age group had a positive
mammography in a routine screening. What is the probability that she actually has breast
cancer?
The same problem can get the form by changing the percentages to real numbers as
follows:
S
100 out of 10,000 women at age forty who participate in routine screening have breast cancer.
80 of every 100 women with breast cancer will get a positive mammography. 950 out of 9,900
N
women without breast cancer will also get a positive mammography. If 10,000 women in this age
A
group undergo a routine screening, about what fraction of women with positive mammographies
H
will actually have breast cancer?
IT
Hints/Solution:
H
Now we pass both groups through the sieve; note that both sieves are the same; they just behave
AT
differently depending on which group is passing through.
Let A be an event that a Woman with/having cancer.
Let B be an event of showing a positive mammography.
F
O
Finally, to find the probability that a positive test actually means cancer, we look at those who
S
passed through the sieve with cancer, and divide by all who received a positive test, cancer or
TE
not.
O
N
Page 12 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
All women
In measuring, we find:
S
cer P(A) = 1% Women
without cancer
N
P(A) = 99%
A
H
IT
H
P(B/A) = 0.8 AT P(B/A) = 0.096
X 0 1 2 3 4 5 6 7
N
2 2 2
P[X=x] 0 k 2k 2k 3k k 2k 7k + k
E
Find (i) the value of k,(ii) the Cumulative Distribution Function (CDF) (iii) P (1.5 < X <
1
R
4.5/X > 2) and (iv) the smallest value of α for which P (X ≤ α) > .
2
TU
Hints/Solution:
C
∞
X
LE
F (x) = P (X ≤ x)
F (0) = P (X ≤ 0) = P (X = 0) = 0
1 1
F (1) = P (X ≤ 1) = P (X = 0) + P (X = 1) = 0 + =
S
10 10
1 2 3
N
F (2) = P (X ≤ 1) = P (X = 0) + P (X = 1) + P (X = 2) = 0 + + =
10 10 10
A
..
.
H
IT
F (7) = P (X ≤ 7) = P (X = 0) + P (X = 1) + P (X = 2) + P (X = 2)
+P (X = 4) + P (X = 5) + P (X = 6) + P (X = 7)
H
100 AT
= =1
100
F
X 0 1 2 3 4 5 6 7
S
TE
P [X = x] 0 k 2k 2k 3k k2 2k 2 7k 2 + k
1 2 2 3 1 2 17
O
P [X = x] 0
10 10 10 10 100 100 100
N
1 3 5 8 81 83 100
F [X = x] 0 =1
E
(iii)
TU
P (X > 2)
LE
5
P (1.5 < X < 4.5) = P (X = 3) + P (X = 4) =
10
P (X > 2) = 1 − P (X ≤ 2)
= 1 − {P (X = 0) + P (X = 1) + P (X = 2)}
3 7
= 1− =
10 10
5
10 5
P (1.5 < X < 4.5/X > 2) = 7 =
10
7
1
(iv) The smallest value of α for which P (X ≤ α) > = 0.5.
2
Page 14 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
5
From the CDF table, we found that P (X ≤ 3) = = 0.5. But we need the probability which
10
8
is more than 0.5, for this we have P (X ≤ 4) = = 0.8 > 0.5. ∴ α = 4 satisfies the given
10
condition.
S
1
the smallest value of α for which P (X ≤ α) > .
2
N
A
Hints/Solution:
H
X 0 1 2 3 4 5 6 7 8
IT
P [X = x] k 3k 5k 7k 9k 11k 13k 15k 17k
1 3 5 7 9 11 13 15 17
H
P [X = x]
81 81 81 81 81 AT81 81 81 81
1
(i) The value of k =
81
F
O
81 81 81 81 81 81 81 81 81
1 4 9 16 25 36 49 64 81
N
F [X = x] =1
81 81 81 81 81 81 81 81 81
E
8
P (0 < X < 3) = P (X = 1) + P (X = 2) =
LE
81
P (X > 2) = 1 − P (X ≤ 2)
= 1 − {P (X = 0) + P (X = 1) + P (X = 2)}
9 72
= 1− =
81 81
8
81 8
P (1.5 < X < 4.5/X > 2) = 72 =
81
72
1
(iv) The smallest value of α for which P (X ≤ α) > = 0.5.
2
Page 15 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
36
From the CDF table, we found that P (X ≤ 5) = < 0.5. But we need the probability which is
81
49
more than 0.5, for this we have P (X ≤ 6) = > 0.5. ∴ α = 6 satisfies the given condition.
81
kx, when 0 ≤ x ≤ 1
k, when 1 ≤ x ≤ 2
Example: 8. Find the value of k for the pdf f (x) = . Also find
3k − kx, when 2 ≤ x ≤ 3
0, otherwise
S
(a) the CDF of X (b) P (1.5 < X < 3.2/0.5 < X < 1.8)
N
Hints/Solution:
A
H
IT
Z∞
H
We know that
AT f (x)dx = 1
−∞
Z0 Z1 Z2 Z3 Z∞
F
−∞ 0 1 2 3
S
Z0 Z1 Z2 Z3 Z∞
TE
−∞ 0 1 2 3
N
1 3
x2 x2
E
i.e. 0 + k +k [x]21 + 3k · x − k · +0 = 1
R
2 0 2 2
TU
i.e. 2k = 1
1
C
=⇒ k=
2
LE
x
, when 0 ≤ x ≤ 1
2
1
, when 1 ≤ x ≤ 2
1
(a) Since k = , f (x) = 2
2 1
(3 − x), when 2 ≤ x ≤ 3
2
0, otherwise
Page 16 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Zx
The CDF of X is F (x) = P (X ≤ x) = f (x)dx
−∞
Zx Zx
x x2
= f (x)dx = dx =
2 4
S
0 0
N
Zx
A
When 1 ≤ x < 2, F (x) = f (x)dx
H
0
IT
Z1 Zx
x 1 1
H
= dx + dx = (2x − 1)
2 AT 2 4
0 0
F
Zx
O
0
TE
Z1 Zx Zx
x 1 1 1
O
= dx + dx + (3 − x) dx = (−x2 + 6x − 5)
2 2 2 4
N
0 0 0
E
When x ≥ 3, F (x) = 1
R
TU
0 whenx < 0
C
x2
LE
when 0 ≤ x ≤ 1
,
2
1
∴ F (x) = (2x − 1), when 1 ≤ x ≤ 2
4
1
(−x2 + 6x − 5),
when 2 ≤ x ≤ 3
4
1, when x ≥ 3
Page 17 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
P [(1.5 < X < 3.2) ∩ (0.5 < X < 1.8)] = P (1.5 < X < 1.8)
Z1.8
1 3
= dx =
2 20
1.5
Z1 Z1.8
x 1 3
P (0.5 < X < 1.8) = dx + dx =
2 2 16
0.5 1
S
P (1.5 < X < 3.2/0.5 < X < 1.8) =
P (0.5 < X < 1.8)
N
16
=
A
20
H
IT
H
AT
Example: 9. Experience has shown that while walking in a certain park, the time X (in minutes)
duration between seeing two people smoking has a density function
F
(
kxe−x , when x > 0
O
f (x) =
0, otherwise
S
TE
Find the (a) value of k (b) distribution function of X (c) What is the probability that a person,
who has just seen a person smoking will see another person smoking in 2 to 5 minutes, in at least
O
7 minutes?
N
(
kxe−x , when x > 0
R
f (x) =
0, otherwise
TU
C
∴ f (x) ≥ 0 ∀ x =⇒ k > 0.
LE
Z∞
(a) We know that f (x) dx = 1
−∞
Z∞
i.e. kxe−x dx = 1
0
−x
∞
e−x
e
i.e. k x − = 1
−1 (−1)2 0
=⇒ k = 1
Page 18 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
(
xe−x , when x > 0
∴ f (x) =
0, otherwise
Zx
F (x) = P (X ≤ x) = f (x) dx
−∞
Zx
S
Here we have x > 0, F (x) = xe−x dx = 1 − (1 + x)e−x , x > 0
N
0
A
(c)
H
Z5
IT
P (2 < X < 5) = f (x) dx
H
2 AT
Z5
= xe−x dx
F
2
O
= −6e−5 + 3e−2
S
and
O
N
Z∞
P (X > 7) = f (x) dx
E
7
R
Z∞
TU
= xe−x dx
C
7
LE
= 8e−7
= 0.007
Page 19 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Example: 10. The sales of convenience store on a randomly selected day are X thousand
dollars, where X is a random variable with a distribution function
0, when x < 0
2
x
, when 0 ≤ x < 1
F (x) = 2
k(4x − x2 ) − 1, when 1 ≤ x < 2
1, when x ≥ 2
Suppose that this convenience store’s total sales on any given day is less than 2000 units(Dollars
or Pounds or Rupees). Find the (a) value of k (b) Let A and B be the events that tomorrow the
S
store’s total sales between 500 and 1500 units respectively. Find P (A) and P (B). (c) Are A
and B are independent events?
N
A
Hints/Solution: The pdf of X is given by
H
0, when x < 0
IT
d x, when 0 ≤ x < 1
f (x) = F 0 (x) = F (x) =
H
dx
k(4 − 2x), AT when 1 ≤ x < 2
when x ≥ 2
0,
F
Z∞
TE
we have f (x)dx = 1
O
−∞
N
Z0 Z1 Z2 Z∞
i.e. f (x)dx + f (x)dx + f (x)dx + f (x)dx = 1
E
R
−∞ 0 1 2
TU
Z0 Z1 Z2 Z∞
i.e. 0 · dx + x dx + k(4 − 2x) dx + 0 · dx = 1
C
−∞ 0 1 2
LE
1
x2
2
+ k 4x − x2 1 + 0 = 1
i.e. 0 +
2 0
1
=⇒ k =
2
0, when x < 0
x, when 0 ≤ x < 1
f (x) =
(2 − x), when 1 ≤ x < 2
when x ≥ 2
0,
Page 20 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Since the total sales X is in thousands of units, the sales between 500 and 1500 units is the event
1 3
A which stands for = 0.5 < X < = 1.5 and the sales over 1000 units is the event B which
2 2
stands for X > 1. =⇒ A ∩ B = 1 < X < 1.5
Now
Z1.5
P (A) = P (0.5 < X < 1.5) = f (x)dx
0.5
Z1 Z1.5
S
3
= x dx + (2 − x) dx =
4
N
0.5 1
A
H
Z2
IT
P (B) = P (X > 1) = f (x)dx
H
1
Z2
AT 1
= (2 − x) dx =
2
F
1
O
Z1.5
S
1
O
Z1.5
3
N
= (2 − x) dx =
8
1
E
R
3 1 3
Here, P (A) · P (B) = · = = P (A ∩ B)
4 2 8
∴ A and B are independent events.
C
LE
Example: 11. If a random variable X has the following probability distribution, find
x −1 0 1 2
E(X), E(X 2 ), V ar(X), E(2X + 1), V ar(2X + 1).
p(x) 0.3 0.1 0.4 0.2
Page 21 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
∞
X
2
E(X ) = x2i p(xi )
i=−∞
S
= 1.5 − 0.25 = 1.25
N
A
H
E(2X + 1) = 2E(X) + 1
IT
= 2 × (0.5) + 1
H
= 1+1= 2 AT
V ar(2X + 1) = 22 V ar(X)
F
= 4 × (1.25) = 5
O
S
TE
O
Example: 12. If a random variable X has the following probability distribution, find
N
x 0 1 2 3 4
2
E(X), E(X ), V ar(X), E(3X − 4), V ar(3X − 4). 1 3 5 7 9
E
p(x)
25 25 25 25 25
R
TU
X
E(X) = xi p(xi )
LE
i=−∞
14
=
5
∞
X
E(X 2 ) = x2i p(xi )
i=−∞
46
=
5
Page 22 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
V ar(X) = E(X 2 ) − [E(X)]2
2
46 14
= −
5 5
34
=
25
E(3X − 4) = 3E(X) − 4
22
= =
S
5
N
V ar(3X − 4) = 32 V ar(X)
A
H
306
=
IT
25
H
AT
Example: 13. A test engineer found that the distribution function of the lifetime X (in years) of
F
(
S
0, when x < 0
F (x) =
TE
− x5
1 − e , when x ≥ 0
O
R
dx e 5 , when x ≥ 0
5
C
LE
Z∞
The Mean E(X) = xf (x)dx
−∞
Z0
1 x
= x e− 5 dx
5
−∞
1 x ∞
= − (5x + 25)e− 5 0 = 5
5
Page 23 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Z∞
Now E(X 2 ) = x2 f (x)dx
−∞
Z0
1 x
= x2 e− 5 dx
5
−∞
1 2 x ∞
= − (5x + 50x + 250)e− 5 0 = 50
5
S
∴ V ar(X) = 50 − [5]2 = 25
N
A
H
Example: 14. Find the mean and standard deviation of the distribution
IT
(
H
kx(2 − x), when 0 <≤ x ≤ 2
f (x) = AT
0, otherwise
(
kx(2 − x), when 0 <≤ x ≤ 2
f (x) =
0, otherwise
S
TE
Z∞
we have f (x)dx = 1
E
−∞
R
Z0 Z2 Z∞
TU
−∞ 0 2
LE
Z0 Z2 Z∞
i.e. 0 · dx + kx(2 − x) dx + 0 · dx = 1
−∞ 0 2
2
x3
2
i.e. 0 + k x − +0 = 1
3 0
3
=⇒ k =
4
Page 24 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Z∞
The Mean E(X) = xf (x)dx
−∞
Z0
3
= x x(2 − x)dx
4
−∞
2
3 x 3 x4
= − 2 − = 1
4 3 4 0
S
N
V ar(X) = E(X 2 ) − [(X)]2
A
H
Z∞
IT
2
Now E(X ) = x2 f (x)dx
H
−∞
Z0
AT
3
= x2 x(2 − x)dx
4
F
−∞
O
2
3 x4 x5
6
= − 2 − =
S
4 4 5 0 5
TE
r
6 1 1
O
0, when x < 1
LE
1
, when 1 ≤ x < 4
3
1
F (x) = , when 4 ≤ x < 6
2
5
, when 6 ≤ x < 10
6
1, when x ≥ 10
Find (a) the probability distribution of X (b) Find the mean and variance of X.
Page 25 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Hints/Solution: Given that the CDF of X is
0, when x < 1
1
, when 1 ≤ x < 4
3
1
F (x) = , when 4 ≤ x < 6
2
5
, when 6 ≤ x < 10
6
1, when x ≥ 10
S
N
We know that P (X = xi ) = F (xi ) − F (xi−1 ), i = 1, 2, 3, . . . , where F is constant in
A
xi−1 ≤ x ≤ xi .
H
The CDF changes its values at x = 1, 4, 6, 10. ∴ The probability distribution takes its values as
IT
follows:
H
AT 1 1
P (X = 1) = F (1) − F (0) = −0=
3 3
F
1 1 1
O
P (X = 4) = F (4) − F (1) = − =
2 3 6
S
5 1 1
TE
P (X = 6) = F (6) − F (4) = − =
6 2 3
O
5 1
P (X = 10) = F (10) − F (6) = 1 − =
N
6 6
E
x 1 4 6 10
R
TU
14
LE
Mean=E(X) = Σxp(x) = .
3
2 2 95
E(X ) = Σx p(x) = .
3
285 196 89
V ar(X) = E(X ) − [E(X)]2 =
2
− = .
9 9 9
Page 26 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Example: 16. If X has the distribution function
0, when x < 0
1
, when 0 ≤ x < 2
6
1
F (x) = , when 2 ≤ x < 4
2
5
, when 4 ≤ x < 6
8
1, when x ≥ 6
S
Find (a) the probability distribution of X (b) Find the mean and variance of X.
N
A
Hints/Solution: Given that the CDF of X is
H
0, when x < 0
IT
1
, when 0 ≤ x < 2
H
6
1
AT
F (x) = , when 2 ≤ x < 4
2
5
, when 4 ≤ x < 6
F
8
O
1, when x ≥ 6
S
TE
The CDF changes its values at x = 1, 4, 6, 10. ∴ The probability distribution takes its values as
follows:
E
R
TU
1
P (X = 0) =
6
C
1 1 1
LE
P (X = 2) = F (2) − F (0) = − =
2 6 3
5 1 1
P (X = 4) = F (4) − F (2) = − =
8 2 8
5 3
P (X = 6) = F (6) − F (4) = 1 − =
8 8
x 0 2 4 6
∴ The probability distribution is given by 1 1 1 3
p(x)
6 3 8 8
Page 27 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
37
Mean=E(X) = Σxp(x) = .
12
2 2 101
E(X ) = Σx p(x) = .
6 2
2 101
2 37
V ar(X) = E(X ) − [E(X)] = − = 16.83 − 9.51 = 7.32.
6 12
Example: 17. The first four moments about X = 5 are 2,5,12 and 48. Find the first four central
moment.
S
Hints/Solution: Let m01 , m02 , m03 , m04 be the first four moments about X = 5. Given m01 =
1, m02 = 5, m03 = 12, m04 = 48 be the first four moments about X = 5 m01 = E(X − 5) =
N
1 =⇒ E(X) − 5 = 1 =⇒ E(X) = µ1 = 6
A
H
µ2 = m02 − (m01 )2 = 5 − 1 = 4
IT
µ3 = m03 − 3m02 · m01 + 2(m01 )3
H
= 12 − 3 × 5 × 1 + 2(1) = −1
AT
µ4 = m04 − 4m03 · m01 + 6m02 · (m01 )2 − 3(m01 )4
= 48 − 4(12)(1) + 6(5)(1) − 3(1) = 27
F
O
S
TE
Example: 18. The first four moments about x = 4 are 1,4,10 and 45. Find the first four moments
about the mean.
O
Hints/Solution:
N
Let m01 , m02 , m03 , m04 be the first four moments about X = 4. Given m01 = 1, m02 = 4, m03 =
E
10, m04 = 45 be the first four moments about X = 4 m01 = E(X − 4) = 1 =⇒ E(X) − 4 =
R
1 =⇒ E(X) = µ1 = 5
TU
µ2 = m02 − (m01 )2 = 4 − 1 = 3
µ3 = m03 − 3m02 · m01 + 2(m01 )3
C
LE
= 10 − 3 × 4 × 1 + 2(1) = 0
µ4 = m04 − 4m03 · m01 + 6m02 · (m01 )2 − 3(m01 )4
= 45 − 4(10)(1) + 6(4)(1) − 3(1) = 26
Example: 19. A random variable X has the pdf f (x) = kx2 e−x , x ≥ 0. Find the rth moment
and hence find the first four moments.
Page 28 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Hints/Solution: We know that
Z∞
f (x) dx = 1
−∞
Z∞
i.e., kx2 e−x dx = 1
0
Z∞
i.e., k e−x x3−1 dx = 1
0
S
Z∞
N
0
A
1
H
i.e., k · 2! = 1 =⇒ k = . [∵ Γ(n) = (n − 1)!]
2
IT
H
Now, The rth moment is given by AT
µ0r = E(X r )
Z∞
F
= xr f (x) dx
O
−∞
Z∞
S
xr kx2 e−x dx
TE
=
0
O
Z∞
N
= k e−x xr+3−1 dx
0
E
1 1
R
= Γ(r + 3) = (r + 2)!
2 2
TU
C
1
Now, First Moment µ01 = (3)! = 3
LE
2
1
Second Moment µ02 = (4)! = 12
2
1
Third Moment µ03 = (5)! = 60
2
1
Fourth Moment µ04 = (6)! = 360
2
1 x
Example: 20. A random variable X has the pdf f (x) = e− 2 , x ≥ 0. Find the MGF(Moment
2
Generating Function) and hence find its mean and variance.
Page 29 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Hints/Solution: The MGF of X is given by
Z∞
MX (t) = E(etX ) = etx f (x) dx
−∞
Z∞
1 x
= etx e− 2 dx
2
0
Z∞
1 1
= e− 2 (1−2t)x dx
2
"0
S
1
#∞
1 e− 2 (1−2t)x
N
=
2 − 21 (1 − 2t)
A
0
1 1
H
∴ MX (t) = if t < .
1 − 2t 2
IT
H
= (1 − 2t)−1 = 1 + 2t + 4t2 + 8t3 + . . .
AT
Now, Differentiating w.r.to t, we get
F
1
TU
Example: 21. A random variable X has the pdf p(x) = x , x = 1, 2, 3, . . . . Find the
2
MGF(Moment Generating Function) and hence find its mean and variance.
C
LE
Page 30 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Hints/Solution: The MGF of X is given by
∞
X
tX
MX (t) = E(e ) = etx p(x)
x=−∞
∞ ∞ t x ∞ t x
X 1 tx
X e X e
= e x = =
x=1
2 x=1
2 x=1
2
" #
2
et et et
= 1+ + + ...
2 2 2
t −1
et
e
= 1−
S
2 2
N
et
∴ MX (t) = if et 6= 2.
A
2 − et
H
IT
H
Now, Differentiating w.r.to t, we get AT
2et
MX0 (t) =
(2 − et )2
F
O
(2 − et )3
TE
Example: 22. A random variable X has the rth moment of the form µ0r = (r + 1)!2r . Find the
C
MGF(Moment Generating Function) and hence find its mean and variance.
LE
Page 31 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Hints/Solution: The MGF of X is given by
t 0 t2 t3 tr
S
∴ MX (t) = E(etX ) = 1 + µ1 + µ02 + µ03 + · · · + µ0r + . . .
1! 2! 3! r!
N
t t2 t3
A
= 1+ 2 + 3!22 + 4!23 + . . .
1! 2! 3!
H
IT
= 1 + 2(2t) + 3(2t)2 + 4(2t)3 + . . .
H
∴ MX (t) = (1 − 2t)−2 .
AT
Now, Differentiating w.r.to t, we get
F
O
=
N
Page 32 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
6 Exercise/Practice/Assignment Problems
1. Find the probability of drawing two red balls in succession from a bag containing 3 red
and 6 black balls when (i) the ball that is drawn first is replaced, (ii) it is not replaced.
2. A bag contains 3 red and 4 white balls. Two draws are made without replacement; what is
the probability that both the balls are red.
3. Box 1 contains 1000 bulbs of which 10% are defective. Box 2 contains 2000 bulbs of
which 5% are defective. Two bulbs are drawn (without replacement) from a randomly
selected box. (i) Find the probability that both balls are defective and (ii) assuming that
both are defective, find the probability that they came from box 1.
S
4. The chance of a doctor D will diagnose a disease Z correctly is 60%. The chance that
N
the patient will survive by his treatment after wrong diagnosis is 40% and the chance
A
of survive for correct diagnosis is 70%. Find the probability of the patient survival. A
H
patient of doctor D, who has disease Z, survives. What is the chance that his disease was
IT
diagnosed wrongly?
H
5. A random variable X has the following distribution
AT
X -2 -1 0 1 2 3
P[X=x] 0.1 k 0.2 2k 0.3 3k
Find (i) the value of k,(ii) the Distribution Function (CDF) (iii) P (0 < X < 3/X < 2)
F
1
and (iv) the smallest value of α for which P (X ≤ α) > .
O
2
1
S
Ans: k =
15
TE
X 0 1 2 3 4
P[X=x] k 2k 5k 7k 9k
N
Find (i) the value of k,(ii) the Distribution Function (CDF) (iii) P (0 < X < 3/X < 2)
1
E
3
1
TU
Ans: k =
24
7. A random variable X has a pdf
C
LE
(
3x2 , when 0 ≤ x ≤ 1
f (x) =
0, otherwise
Find the (i) Find a, b such that P (X ≤ a) = P (X > a) and P (X > b)r= 0.05,(ii) r the
3 1 3 19
Distribution Function (CDF) (iii) P (0 < X < 0.5/X < 0.8). Ans: a = ,b=
2 20
8. The amount of bread (in hundred kgs) that a certain bakery is to sell in a day is a random
variable X with a pdf
Ax,
when 0 ≤ x < 5
f (x) = A(10 − x), when 5 ≤ x < 10
0, otherwise
Page 33 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
Find the (i) the value of A,(ii) the Distribution Function (CDF) (iii) P (X > 5/X <
5), P (X > 5/2.5 < X < 7.5). (iv) the probability that in a day the sales is (a) more than
1
500 kgs (b) less than 500 kgs (c) between 250 and 750 kgs. Ans: A =
25
9. The cumulative distribution function (CDF) of a random variable X is given by
1 − 4 , when x > 2
F (x) = x2
0, otherwise
Find the (i) the pdf of X,(ii) P (X > 5/X < 5), P (X > 5/2.5 < X < 7.5) (iii)
S
P (X < 3), P (3 < X < 5).
N
10. A coin is tossed until a head appears. What is the expected value of the number of tosses?.
Also find its variance.
A
H
11. The pdf of a random variable X is given by
IT
(
a + bx, when 0 ≤ x ≤ 1
H
f (x) =
0, otherwise
AT
Find the (i) the value of a, b if the mean is 1/2,(ii) the variance of X (iii) P (X > 0.5/X <
0.5)
F
O
12. The first three moments about the origin are 5,26,78. Find the first three moments about
the value x=3. Ans: 2,5,-48
S
TE
13. The first two moments about x=3 are 1 and 8. Find the mean and variance. Ans: 4,7
O
(
k(1 − x), when 0 ≤ x ≤ 1
f (x) =
E
0, otherwise
R
TU
Find the (i) the the value of k,(ii) the rth moment about origin (iii) mean and variance.
Ans: k = 2
C
15. An unbiased coin is tossed three times. If X denotes the number of heads appear, find the
LE
For this find the MGF and prove that mean and variance cannot be find using this MGF
and then find its mean and variance using expectation.
Page 34 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
−|x|
18. The pdf of a random variable X is given by f (x) = ke , −∞ < x < ∞ Find the (i) the
the value of k,(ii) the rth moment about origin (iii) the MGF and hence mean and variance.
1
Ans: k =
2
19. Find the MGF of the RV whose moments are given by µ0r = (2r)!. Find also its mean and
variance.
S OLVE M ORE P ROBLEMS FROM THE T EXTBOOK AND R EFERENCE B OOKS
S
N
A
H
IT
Figure 1: Values of e−λ .
H
AT
Contact: (+91) 979 111 666 3 (or) athithan.s@ktr.srmuniv.ac.in
Visit: https://sites.google.com/site/lecturenotesofathithans/home
F
O
S
TE
O
N
E
R
TU
C
LE
Page 35 of 36 https://sites.google.com/site/lecturenotesofathithans/home
Probability & Statistics S.ATHITHAN
S
N
A
H
IT
H
AT
F
O
S
TE
O
N
E
R
TU
C
LE
Page 36 of 36 https://sites.google.com/site/lecturenotesofathithans/home