184 MATHEMATICS AND THE LAWS OF NATURE
But it is sometimes the case that scientists are unsure about the
precise state of the system at any time and that they have no meth-
od for eliminating this uncertainty. Scientists have, for example,
developed a wide variety of predictions about motions occurring
deep within the Earth. (These predictions are generally made with
differential equations and random processes
As a matter of definition, it is not possible to accurately predict individual
random events. (If they could be predicted, they would not be random.)
Instead of individual outcomes, researchers predict the frequencies with
which various outcomes will occur. Experience has shown that frequen-
cies can be accurately predicted.
Central to the idea of prediction in random systems is the concept
of the ensemble. Here is the basic idea: Suppose we are interested in
describing an experiment that has a random component to the outcome.
(Think, for example, of Mendel and his pea plants.) We begin by imagin-
ing that we have performed the experiment many times. The result is a
very large set of experimental runs, each of which is called a “realiza-
tion” of the experiment. The ensemble is the set of all such realizations.
(From a practical point of view, it is often more convenient to imagine the
ensemble as an infinite set of realizations, although, of course, there is
never enough time or money to run an experiment infinitely often. In that
sense the ensemble is a fiction, but it is a useful fiction.)
The next step is to actually perform the experiment several times and
record the results. If this is done correctly, the researcher obtains a rep-
resentative sample of the ensemble. (Sometimes the word ensemble is
used to refer to the sample as well as the parent population from which it
was drawn.) The sample is used to draw conclusions about the statisti-
cal properties of the ensemble. These conclusions are used to predict
the statistics of future experimental runs.
The idea of using a sample to better understand a large parent
population is not, of course, a new one. Advertising firms, for example,
will assemble “focus groups,” representative samples of a much larger
target market, and test the effectiveness of different advertising cam-
paigns on the focus groups. The campaigns that they choose and the
campaigns that they discard will be determined, in part, by the focus
groups’ reactions, which are supposed to accurately reflect those of the
target market.