228 7 Queuing Analysis
of the famous M/M/1 queue for the continuous-time case. At a certain time step,
the probability of packet arrival is a, which is equivalent to a birth event or increase
in the queue population. The probability that a packet did not arrive is b = 1 − a.
The probability that a packet leaves the queue is c, which is equivalent to death or
reduction in the queue population. The probability that a packet does not leave the
queue is d = 1 − c. The probability c is representative of the server’s ability to
process the customers or packets in the queue in one time step.
The number of customers or packets stored in the queue is the state of our system.
Thus, the queue is in state s
i
when there are i customers or packets in the queue.
The state transition diagram for the discrete-time M/M/1 queue is shown in Fig. 7.1.
Changes in the queue size occur by at most one, i.e., only one packet could arrive or
depart. Thus, we expect the transition matrix to be tridiagonal.
The future state of the queue depends only on its current state. Thus, we can
model the queue as a discrete-time Markov chain. Since packet arrivals and de-
partures are independent of the time index value, we have a homogeneous Markov
chain. We assume that when a packet arrives, it could be serviced at the same time
step and it could leave the queue with probability c. This results in the transition
matrix given by
P =
⎡
⎢
⎢
⎢
⎢
⎢
⎣
f
0
bc 00···
ad f bc 0 ···
0 ad f bc ···
00ad f ···
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
⎤
⎥
⎥
⎥
⎥
⎥
⎦
(7.7)
where b = 1 −a, d = 1 −c, f
0
= 1 −ad, and f = ac +bd.
For example, starting with an empty queue (state s
0
), Fig. 7.1 indicates that we
move to state s
1
only when a packet arrives and no packet can depart, which is term
ad in the diagram. This transition is also indicated in the above transition matrix as
the term at location (2,1) of the transition matrix.
In order for the queue to be stable, the arrival probability must be smaller than
the departure probability (a < c).
Since the dimension of P is infinite, we are going to obtain an expression for the
distribution vector s using difference equation techniques instead of studying the
eigenvectors of the matrix. The difference equations for the steady-state distribution
vector are obtained from the equation
Ps= s (7.8)
Fig. 7.1 State transition
diagram for the discrete-time
M/M/1 queue
0 1 2
fbc
ad
1-ad
...
f
ad
bcbc
ad