A.1. The Meaning of a Measurement 347
If another researcher repeated this experiment with only one plant in
each group and found the control plant was 13.6 cm tall and the ex-
perimental one was 13.4 cm tall, would that data be surprising? What
conclusion would that experimenter be likely to draw based solely on
that data? Is your data compelling enough to say the other researcher’s
conclusion is wrong?
Clearly, an important issue in analyzing this data is understanding the
variability within each group. In fact, you have probably already made
some hypotheses as to why the numbers might be so varied within each
group.
Give as many reasons as you can for the variability in the data.
It’s worth distinguishing two main reasons why data might vary. The first,
called experimental error, is due to mistakes made (perhaps unavoidably) on
the part of the experimenter. For instance, the ruler used for measuring height
might be inaccurate, or the location of the top of the plant might have been
misjudged, or the nutrient may not have been applied in exactly the amount
claimed.
The second reason is that, in dealing with a very complicated system such as
a living organism, there are simply more variables than we can possibly control
at once. For instance, the beans may differ genetically, and the conditions of
soil, light, and air that each plant is exposed to are not identical no matter
how hard we try to make them so. One could argue that this is all a form of
experimental error, in that we have not been able to carry out our experiment
carefully enough. That misses the point, though, because if the experiment
could be carried out so that none of this variability were present, then our
results might actually be less meaningful. Knowing how all clones of a specific
bean would respond to certain very specific conditions may well be less
valuable than knowing how a random sampling of beans will behave in a less
tightly controlled setting.
In studying anything complicated (and biological system are all compli-
cated), we should expect variability in measurements. Experimental error
should, of course, be minimized, but variability in the data often will remain.
We should take lots of measurements to be sure we have a good idea of the
nature of this variability, so that the variability within the data does not ob-
scure the effects we are trying to measure. The more data we have, the better
conclusions we should be able to draw.
We have now arrived at the central problem the discipline of statistics
is designed to address. Too little data can be misleading, so that we draw
incorrect conclusions, but too much data becomes incomprehensible to us.