4.2 (Limits of) Empirical Performance Measures
In Section 3.1 we use the arrival times \(\{A_{k}\}\) and the service times \(\{S_k\}\) to construct the waiting times \(\{\W_k\}\), the sojourn times \(\{\J_k\}\), the arrival process \(\{A(t)\}\), the departure process \(\{D(t)\}\), and the number in the system \(\{\L(t)\}\). If the queueing system is rate stable, several long-run average performance measures1 Also known as `steady-state' or `stationary' limits. along sample paths exist almost surely.2 Proving the existence of these limits below requires substantial mathematics; see S. Asmussen (2003), Applied Probability and Queues for details. Here we assume these limits exist.
As the next example demonstrates, we need to distinguish between sampling the system at arrival times and sampling it over time. Suppose that jobs arrive exactly at the start of an hour and require 59 minutes of service time. If we sample the server occupancy at arrival epochs, the server is always idle, whereas over time it is almost always busy. Thus, what jobs see upon arrival generally differs from what the server perceives.
One set of measures focuses on what customers perceive at the moment of arrival.3 Such statistics are often described as `as seen by arrivals'. The expectation and distribution function4 This is simply counting. of the waiting time are obtained from, respectively,
\begin{align*} \E{\W} &= \lim_{n\to\infty} \frac 1 n\sum_{k=1}^n \W_{k}, & \P{\W \leq x} &= \lim_{n\to\infty} \frac 1n\sum_{k=1}^n \1{\W_k\leq x}. \tag{4.2.1} \end{align*}For the sojourn time \(\J\), we use similar definitions.
Since \(L(A_k-)\) denotes the number of jobs in the system just before the \(k\)th arrival5 Note the \(A_k-\); since \(L(t)\) is right-continuous, we focus on what an arrival sees just before its arrival. , the average and distribution function of the number of jobs in the system as seen by arrivals are given by
\begin{align*} \E\L &= \lim_{n\to\infty}\frac 1 n \sum_{k=1}^n L(A_k-), & \P{\L \leq m} &= \lim_{n\to\infty} \frac 1n\sum_{k=1}^n \1{\L(A_{k}-)\leq m}. \tag{4.2.2} \end{align*}A second set of performance measures follows by tracking the system's behavior over time and taking the time-average.6 These performance measures are `as seen by the server'. Since at time \(s\) the number in the system is \(L(s) = A(s) - D(s)\), we define the time-average number of jobs7 Although the symbol is the same, this expectation need not be the same as Eq. (4.2.2). and the time-average fraction of time the system contains at most \(m\) jobs, respectively, as
\begin{align*} \E\L &= \lim_{t\to\infty} \frac 1 t\int_0^t L(s) \d s, & \P{\L\leq m} &=\lim_{t\to\infty} \frac 1 t\int_0^t \1{\L(s)\leq m} \d s. \tag{4.2.3} \end{align*}Claim: If the limit exists, then
\begin{equation*} \frac{1}{t} \sum_{k=1}^{A(t)} \1{\W_k \leq x} \to \P{W\leq w}, \quad t\to \infty. \end{equation*}Solution
Solution, for real
False.
\begin{equation*} \frac{1}{t} \sum_{k=1}^{A(t)} \1{\W_k \leq x} = \frac{A(t)}{t} \frac 1{A(t)}\sum_{k=1}^{A(t)} \1{\W_k \leq x} \to \lambda \P{W\leq x}. \end{equation*}Moreover, the final \(w\) in the claim should be \(x\).
The departure process \(\{D(t)\}\) can be computed from the set \(\{D_k\}\) of departure times as
\begin{equation*} D(t) = \sum_{k=1}^\infty \1{D_k \leq t}. \end{equation*}Solution
Solution, for real
True.
Claim: In general, the time-average number of jobs in the system equals the number of jobs seen by arrivals.
Solution
Solution, for real
False. These are equal only under special conditions, such as when arrivals form a Poisson process (PASTA). As a counterexample, with constant inter-arrival time \(X=10\) and service time \(S=9\), arrivals always see an empty system, but the time-average number in the system is \(9/10\).
Claim: The fraction of time the system contains \(n\) or more jobs can be computed as \(\P{\L \geq n} = \lim_{t\to\infty} \frac{1}{t}\int_0^t \1{\L(s) \geq n} \d s\).
Solution
Solution, for real
True. This is the time-average definition of \(\P{\L \geq n}\).
Claim: The empirical distribution of the waiting time \(\P{\W \leq x} = \lim_{n\to\infty} \frac{1}{n}\sum_{k=1}^n \1{\W_k \leq x}\) samples at arrival epochs, hence it captures what customers experience.
Solution
Solution, for real
True. This is a sample-average over arrivals, so it reflects the customer perspective.
Design a queueing system where the time-average number of jobs in the system differs markedly from what arrivals observe.
Hint
Consider a queueing system with constant service times and constant inter-arrival times.
Solution
Solution, for real
Take \(L(0) = 0\), \(X_k = 10\) and \(S_k = 10-\epsilon\) for some tiny \(\epsilon > 0\). Then \(L(t) = 1\) almost always. Indeed, \(\lim_{t\to\infty}t^{-1}\int_0^t L(s) \d s= 1-\epsilon/10\). However, \(L(A_k-)=0\) for all \(k\).
If \(L(t)/t \to 0\) as \(t\to\infty\), can \(\E{\L}\) still be positive?
Solution
Solution, for real
If \(L(t)=1\) for all \(t\), \(\E{\L} = 1\), yet \(L(t)/t \to 0\).