Академический Документы
Профессиональный Документы
Культура Документы
0
1
2
3
0
1
2
1
(a) Identify the communicating classes of this Markov chain and indicate whether each
is open or closed.
(b) Write down the generator for this process.
(c) Derive an expression for the probability that a person with AIDS will die after
time t.
(d) Comment on the validity of the assumption of time homogeneity in this example.
QUESTION 4 [19 marks]
A factory has two machines and one repairman. Each machine fails independently after
an exponential amount of time with rate . The time taken to repair a machine is
exponentially distributed with rate . Suppose that the number of broken machines
{X
t
, t 0} at time t is modelled as a continuous-time Markov process.
(a) Draw a state transition diagram for this process indicating the transition rates.
(b) Find the stationary distribution.
(c) Carefully explain how you would simulate n events of this process.
(d) Suppose that the following data were observed:
Time 0.9 1.7 2.2 2.8 3.3 3.9 4.9 5.8 6.6 7.6 7.8 8.6 9.3
State 0 1 2 1 0 1 2 1 2 1 0 1 2
Obtain maximum likelihood estimates for and .
(e) Use your estimates from part (d) to compute the average number of broken ma-
chines.
2
QUESTION 5 [5 marks]
Consider a random walk {S
n
, n = 0, 1, . . .} on Z.
(a) Show that the number of paths from (0, 0) to (n, x), where x 0, that never cross
but may touch the t-axis is given by
_
n
n+x
2
_
_
n
n+x
2
+ 1
_
.
(b) Hence, show that the number of paths from (0, 0) to (n, 0), where n is even, that
never cross but may touch the t-axis is given by the Catalan numbers
C
n/2
=
1
n
2
+ 1
_
n
n
2
_
for n = 0, 2, 4, . . .
SECTION B
Answer this section in a separate book.
QUESTION 6 [10 marks]
(a) Let (, F, P) be a probability space and let N = {1, 2, ..., n
0
}, n
0
. Dene a
ltration with respect to the probability space and the index set N. (1)
(b) A coin is tossed twice in succession.
(i) Let A be the event that there is at least one head. What is the -eld
generated by A? (1)
(ii) What is the most powerful ltration for this random experiment? (3)
(c) Let X be a random variable and let g : be continuous and strictly increas-
ing. Show that g(X) is a random variable. (5)
QUESTION 7 [21 marks]
Two candidates, A and B run for an election with n voters. They obtain a and b votes
respectively, where a > b.
(a) Let S
k
= (# As votes) (# Bs votes) after k votes are counted. Show that after
k votes are counted, that the number of votes for A is
k+S
k
2
and the number of
votes for B is
kS
k
2
. (3)
(b) Show that
P(S
k
= S
k+1
+ 1|S
k+1
) =
k + 1 S
k+1
2(k + 1)
. (2)
3
(c) Let X
k
=
S
nk
nk
for 0 k n 1. Show that X
n
is a martingale. (8)
(d) Let T = min{k : X
k
= 0} and T
= min(n 1, T).
(i) Show that the optional stopping theorem is applicable to the stopping time
T
. (2)
(ii) By applying the optional stopping theorem to T
.
(b) Consider the stochastic dierential equation:
dS
t
= S
t
dt + S
t
dB
t
.
Show that S
t
/S
0
is log-normally distributed. (6)
4
FORMULAE
f(x) =
t
1
e
ij
(t) =
k
p
ik
(t)q
kj
p
ij
(t) =
k
q
ik
p
kj
(t)
j
=
j
q
jj
i
q
ii
j
=
j
/q
jj
i
/q
ii
p
ij
(t) =
n=0
[
R
n
]
ij
(qt)
n
exp{qt}
n!
(Q) = ln p
0
(y
0
) +
j=i
B
ij
ln q
ij
+
i
q
ii
A
i
P[N < ] = 1
E
_
sup
n0
|X
Nn
|
<
E[N] <
E
_
|X
n+1
X
n
|
Y
0
, . . . , Y
n