256 CHAPTER 20
about its rarity in the population from which the sample came (Chapter19). All these
analyses would provide us with ways to say how much confidence we had that some
observation of interest in the sample reflected something that occurred in the pop-
ulation from which the sample was selected as well. This is a very straightforward
application of the principles in Chapters
9–18.
If we had a large sample of Early, Middle, and Late Archaic projectile points,
we might well do all these same things with it – means and proportions with error
ranges, significance tests of the differences between Early and Middle or Middle
and Late, and so on. We have to stop and think for a minute, though, about just what
population it is that we are talking about on the basis of our sample. Probably, the
population is something like the large and very vaguely defined set of all projectile
points made during the Early, Middle, and Late Archaic. Our interest is likely to be
in identifying some kind of change from one period to the next in very general terms.
We still clearly have a sample, and we can imagine the population we are talking
about even if it is a fairly nebulous population. The sample has not been selected
with truly random procedures, so the issue of sampling bias is highly relevant in this
example, unlike the previous one (Chapter
7).
If we excavated a Formative village in its entirety, recovering information about
27 house structures from Early, Middle, and Late Formative, the same list of statis-
tical tools might be put to use. If we had excavated all the houses at the site, though,
it is even less clear what sense it makes to talk about these houses as a sample.
What is the population they are a sample from? Aren’t they the complete popula-
tion? And does this mean we can’t investigate the significance of a difference we
might observe between, say, Early and Middle Formative? In a case like this, there
are several kinds of populations we might implicitly be interested in. One is the pop-
ulation of all houses that existed at the site at any point in the Formative. Some have
surely been destroyed by the construction of subsequent houses and other processes.
Our sample is not this complete population, but in some contexts this would be the
complete population of interest to us. In other contexts, we might use the sample
of excavated Early Formative houses from this site as a way of talking about Early
Formative houses in general. The relation between our sample and the population of
interest in this context is similar to the first example concerning Archaic projectile
points.
If we surveyed a whole region completely, with 100% coverage, it would become
even more difficult to identify just what population we take our sample to represent.
Presumably some sites would have been destroyed or made inaccessible to survey,
but if conditions were so propitious for survey that we recovered data on almost all
the sites, talking about our sites as a sample from a larger population has become
very forced. What would it mean to talk about, say, the significance of a difference
in mean site size between the Neolithic and the Bronze Age? We could certainly
perform the calculations necessary to say that the mean site area in the Neolithic
was 1.4 ±0.2ha at the 95% confidence level and in the Bronze Age it had changed
to 3.6 ±0.3ha. (Or, instead, we could perform a t test and find out that the signif-
icance of the difference in mean site area between Neolithic and Bronze Age sites
was very high.) We would thus have very high confidence that Bronze Age sites