Waiting Lines Queues

Queuing Theory
Managers use queuing models to be more efficient in providing customer service. Models measure average waiting times and average length of waiting lines.

Historical Roots
Agner Krarup Erlang, a Danish engineer who worked for the Copenhagen Telephone Exchange, published the first paper on queueing theory in 1909. David G. Kendall introduced an A/B/C queueing notation in 1953.

Three queuing disciplines used in Telephone Networks

First In First Out This principle states that customers are served one at a time and that the customer that has been waiting the longest is served first.[5] Last In First Out This principle also serves customers one at a time, however the customer with the shortest waiting time will be served first.[5] Processor Sharing Customers are served equally. Network capacity is shared between customers and they all effectively experience the same delay Source: Wikipedia.org

FIFO First In First Out

LIFO Last in First Out

Elevators are a circumstance where this occurs.

SIRO Service In Random Order

Single-server Single-stage Queue

Arrival Stream

Customers In queue

Service Facility

Waiting for the Newest ????????

Multiple-server Single-stage Queue

Customers In queue Service Facilities

Single-server Multiple-stage Queue

Customers In queue

Service Facility

Pharmacy Conveyor System >>>>>

Multiple-server Multiple-Stage Queue

Customers In queue

Service Facilities

Little's Theorem
Little's theorem: L = / The average number of customers (N) can be determined from the following equation: Here lambda () is the average customer arrival rate and mu () is the average service time for a customer.

Queuing system state probabilities (Basic Model)

P0 = 1 -
Probability distribution for the number of customers in the system

= Pn =

( )

P0

1, 2, 3,n =

Queuing Formulas
(Basic Model)
Average # of Customers in the system L=

-
W = L

Average Customer Time spent in the system

Average # of Customers waiting (length of line) Lq

Lq

2 = ( - )

Average Customers waiting time

Wq

= = ( - )

Server Utilization Factor

Phlebotomy Room Example

A queuing system for blood draws. An average of 25 patients arrive for a blood draw each hour. One full-time (very experienced) phlebotomist can take one patient every two minutes, thus 30 draws per hour can be done.

Queuing Formulas
(Basic Model)
= 25 Pts per hour

= 30 Pts per hour

L=

Average # of Patients in the system:

-
W =

25 30 - 25

= 5 customers 1 = 30 - 25 5

Average Patient Time spent in the system:

hour

Average # of Patients waiting:

Lq =

( - )
Lq

(25)2
30 (30 - 25)

25
6

= 4

1 6 customers

25

Average Patients waiting time:

Wq =

( - )
25 30

30 (30 - 25)

1 6

hour

Server Utilization Factor:

5 6

= The phlebotomist is busy five-sixths of the time.

The system state probabilities

25 P0 = 1 - = 1 = .1667 30
P1 =

( ) ( )

1 2

25 P0 = 30 (.1667) = .1389 P0 =

( )

P2 =

( )

25 2 30 (.1667) = .1158

This formula provides the probability that n (0, 1, 2, 3, ) patients will be in the blood drawing room. If you add the individual probabilities for values of n cumulatively you would find 54 in the number of patients where all probabilities of n total 1.

Multiple server models

Uses same notation as basic model but different formulas. Formulas are based on FIFO discipline. The customer at the head to waiting line proceeds to the first server. S = Number of service channels

Queuing system state probabilities (Multiple Servers)

P0
n ( / ) = 1 [ n!
S-1

n=0

( /)s 1 S! 1 - /S

Pn =

( /)n P 0 n! ( /)n S!Sn-s

If 0 < n < S
If n > S

Phlebotomy Room Example with a second Phlebotomist

Multiple Servers

A 2 service channel queuing system for blood draws. An average of 50 patients arrive for a blood draw each hour. Two full-time phlebotomists can take one patient each every two minutes, thus 60 draws per hour can be done.

The Probability that there are no patients in the system.

S = 2 service channels = 50 Pts per hour

= 60 Pts per hour

P0

0 ( / ) = 1 0!

[ (50 /60) 1 [ 0!
[
1+

+
0

( /)1 1!

1 ( /)2 1 - /2 2!

)]
)]

1 (50 /60)1 (50 /60)2 + 1 - 50/2(60) 1! 2!

+

= 1

.833

(.833)2 2!

( 1 - 1.416 )]

= 1 /[1 + .833 + .594] = 1 / 2.427 = .412

Queuing Formulas
S = 2 service channels Average # of Patients waiting:

(Multiple Servers) = 50 Pts per hour

Lq = (/)2 (/S) S! (1 - /S)2 Lq Wq = P0

= 60 Pts per hour

Average Patients waiting time:

Average Patient Time spent in the system:

W = Wq +

Average # of Patients in the system:

L = Lq +

Server Utilization Factor:

Queuing Formulas
S = 2 service channels Average # of Patients waiting:

(Multiple Servers) = 50 Pts per hour

Lq

= 60 Pts per hour

(50/60)2 (50/2(60)) = (.412) = .175 2! (1 - 50/2(60))2 Lq .175 = 50 = .0035 = 12.6 seconds

Average Patients waiting time:

Wq =

Average Patient Time spent in the system:

1 W = Wq + = .0035 + 1/60 = .0035+.016 = .0195 = .0195 hour = 1.17 minutes = .175 + 50/60 = .175 + .833 = 1.008 pts

Average # of Patients in the system:

L = Lq +

Server Utilization Factor:

= 50/ 2(60) = 0.416

Two Fax machines example

An organization is considering renting 2 fax machines. The 2006 model can send 100 faxes per minute. However, loading the originals and entering the receiving phone number slows the process. The vendor indicates the effective service rate is .5 job per minute. The demand for fax service in the organization is projected at 3 jobs every 5 minutes (.6 job per minute) S = 2 service channels = .5 job per minute = .6 job per minute

The Probability that there are no patients in the system.

S = 2 service channels

= .5 job per minute

= .6 job per minute

P0

0 ( / ) = 1 0!

[ (.6 /.5) 1 [ 0!
[
1+

( /)1 1!

1 ( /)2 1 - /2 2!

)]

(.6 /.5)1 (.6 /.5)2 + 1! 2!

+

( 1 -1.6/2(.5) )] )]

= 1

1.2

(1.2)2 2!

1 1 - .6

= 1 /[1 + 1.2 + 1.8] = 1 / 4 = . 25

Queuing Formulas
S = 2 service channels Average # of Jobs waiting:

(Multiple Servers) = .5 job per minute = .6 job per minute

Lq = (/)2 (/S) S! (1 - /S)2 Lq Wq = = P0 (.6/.5)2 [.6/2(.5)] = 2! [1 - .6/2(.5)]2 (. 25) = .68 job

.68 .6 = 1.13 minutes

Average job waiting time per job:

Average Job Time spent in the fax room:

W = Wq +

= 1.13 +

.5

= 3.13 minutes

Average # of jobs in the fax room:

L = Lq +

= .68 +

.6 .5

= 1.88 jobs

Establishing a queuing system cost

Consider the average hourly cost of operating two rented fax machines. Each job is personally processed by the user. The average hourly payroll cost is $10. Machine rental is a straight $.05 per copy, and an average job involves 12 copies. The average number of jobs per hour is: .6 X 60 = 36 jobs Each employee spends an average of W = 3.13 minutes: 3.13/60 = .0522 hour Average cost of labor lost making copies: $10 X 36 X .0522 = $18.79 Hourly rental cost : $.05 X 12 X 36 = $21.60 Total hourly average cost of operating two machines: $18.79 (labor cost) + $21.60 (equipment rental) = $40.39

Two compared to one fax that is twice as fast.

One would would think that one server twice as fast would produce identical results to two servers. THIS IS NOT TRUE. If so we would not need a different model for multi-channel queues. If a 2008 model fax is twice as fast as the 2006 model is there a difference? If = 1 job per minute. Average # of jobs waiting: Average Patients waiting time:
Lq = 2

( - )
Lq

(.6)2 1(1 - .6)

.36 .4

= .9 Job (2008 model)

.9 = .6

Wq =

W =

( - )
1 =

= 1.5 Minutes (2008 model)

Average job time spent in fax room:

1 = 2.5 Minutes (2008 model) 1 - .6

Results in a smaller hourly labor cost. $10 X 36 X

2.5 60

= $15.00

The new model might rent for a little more than the older model, but would still be cheaper than two 2006 models.

Single Server Model w/a finite queue

A waiting line of limited length is called a finite queue. e.g., Hospital Emergency room with a limited number of beds. If the number of patients reaches a given point additional patients are diverted. The patient (customer) who does not enter the system does not return. There are not limits on the number of patients waiting for service

Probabilities for # of patients in the system

P0 =

1 - / 1 - ( /)M + 1
(M + 1)( / )M+1 1 - (

Pn = ( /)n P0 for 1 < n < M

/

Average # of patients in the system Average length of waiting line Average patient waiting times

L=

1 - /

/)M+1

Lq = L (1 Po) Wq = Lq (1 PM) W= L (1 PM)

Summary
What is queue? Queue disicplines
FIFO LIFO SIRO

A waiting line.

Queuing models
Single server Single stage Multiple server Single stage Single server Multiple stage Multiple server Multiple stage

Single Server Model w/a finite queue