S
tocha
stic Modelling
(Tim
e Series Analysis) and Forecasting 63
4.1.2 The Autocorrelation Function (acf)
For a sequence
of
observations
zl'
z2'
...
, zn' the autocorrelation coefficient
at lag
'k' is defined as: P
k
= E[(zi-
Il)(z
i+k-
Il
)]/
~E(Z
i
-1l)2
E(zi+k
-1l)2
, where
E stands for the expectation or expected value. For a stationary process, the
variance is the same at time
t + k as at t. For k = 0,
Po
= 1. The plot
of
autocorrelation coefficients PI' P2' ... Pkas a function
of
lag (k) is called the
autocorrelation function
of
the process. Generally speaking,
if
the
'acf
' is
of
(i) infinite damped exponentials and/damped sine waves form , the process
is autoregressive; (ii)
ifit
cuts the X-axi s (finite), it is mov ing average (MA),
and (iii)
if
it is infinite damped exponentials and/or damped sine wav es after
q-p first lags, then the process is autoregressive and moving average model
(ARMA).
Standard Error
of
Autocorrelation Estimates
In the process
of
identification
of
the appropriate model, it is nece ssary to
verify in the first instance, whether the population autocorrelation coefficient
P
k is zero beyond a certain lag k. Bartlett (1946) has given an approximate
expression for the variance
of
the estimated autocorrelation coefficient (r
k
)
of
a stationary Normal process and this can be used for the said purpose.
+
~
Var(r
k
)
==
~
I
{p~
+Pv
+
kP
v-
k
-4P
kP
vPv-
k
+2p~p
l}
(4.1)
V = -cx::>
The variance
of
the estimated autocorrelations r
k
at lags k > some value
q beyond which the theoretical autocorrelation function may be treated as
petered out. Bartlett's approximation gives:
q
Var (rk)
==
~
{I + 2 I
p~},
k > q
v =1
Standard Error (S.E) =
~Var(r
k)
.
(4.2)
If the assumption is that the series is completely random, we have q =
0. Therefore, for all lags, r
k
is zero and hence Var (r
k)
:::
~
.
S.E = .JVar .
Employing these statistics,
95%
confidence limits (± 1.96 S.E) can be worked
out for the autocorrelations. Any points exceeding these limits can be
considered as significant.
Partial Autocorrelation Function (pact)
The quantity
<P
kk regarded as a function
of
the lag k is called the partial auto-
correlation function (see eqn. 4.5 below).
The partial autocorrelation coefficients may be estimated by fitting suc-
cessively autoregressive proce sses
of
order I, 2, 3 ... by least squares and
, , ,
picking up the estimates
<P1I'
<P22
'
<P3
3' ...
of
the last coefficient fitted at each