13.6 Randomness and Foundations of Probability 103
even about mean values. One might have the impression that the ideal ob-
jects of study in probability and statistics would be such deterministically
unpredictable systems, but as we will see this does not appear to be a correct
viewpoint.
As a possible example of a random system, let us consider the process
of coin-tossing, which is studied with probabilistic methods in any text on
probability or statistics. The assumption is that it is impossible to predict the
outcome of head or tail of a single coin toss. As a compensation the notion
of probability is introduced aimed at describing that tossing the coin many
times will show approximately an equal number of heads and tails (if there is
nothing wrong with the coin). One would thus associate a probability of 1/2
to both head and tail.
From a deterministic point of view the process of coin tossing may be
described by the equations of motion for a rotating coin based on Newtons
2nd law, that is as a dynamical system based on a simple law as we have dis-
cussed. This system is very sensitive to perturbations in e.g. initial conditions,
which makes it satisfy condition (1). A simplified model for coin tossing is the
harmonic oscillator with the solution u(t) describing the rotation of the coin
during the tossing, with the outcome being say head if u(
ˆ
t ) > 0 and tail if
u(
ˆ
t ) < 0, where
ˆ
t is the final time when the coin hits the table (and u(
ˆ
t ) = 0
would correspond to the unlikely outcome that the coin ends up balancing
vertically on its perimeter). We may here assume that we always initiate the
coin with the same initial conditions u(0) = 1 and ˙u(0) = 0 say, and the
unpredictable nature of the outcome of the tossing would then correspond
to small perturbations in the choice of final time
ˆ
t, as in the above study of
the harmonic oscillator. Viewing coin tossing this way would correspond to
viewing it as a deterministic chaotic dynamical system with continuous time,
for which a pointwise output in time would be unpredictable, but for which
a mean value in time would be predictable. The predictability of the mean
value in time would then result from carefully following one single coin toss
and observing that half of the time of the toss the coin would have heads up.
However, in probability theory coin tossing is instead viewed as a process
with discrete time, where the coin jumps from an initial state u(0) at initial
time 0 to a final state u(
ˆ
t ) at final time
ˆ
t. Here time appears to be discrete
with only two values 0 and
ˆ
t, and the motion of the coin under a continuous
change of time is not observed. It is like closing the eyes during the toss and to
only open them at the end of the toss to observe the outcome. The assumption
is now made that it is impossible to say anything about a single coin toss,
representing a jump from u(0) to u(
ˆ
t ). To say anything about properties of the
coin or the process of coin tossing, we would have to toss the coin many times
corresponding to ensembles of solutions from which we can experimentally
compute mean values and probabilities. Alternatively, for an ideal coin one
could use probability theory based on (in this case very simple) combinatorics,
noting that for an ideal toss of an ideal coin head and tail represent 2 equally
possible outcomes, to compute the the probability for each outcome to be 1/2.