dislodge by coughing, and their large surface area makes it difficult for
macrophages to engulf them. The resultant inflammation and scarring of
lung tissue leads to a high incidence of cancer.
A mineralogist helped a drug company develop and test a new and
extremely expensive drug that was hoped to reduce mortality in people
suffering from mesothelioma. A large experiment was done where half of
mesothelioma cases chosen at random received the new drug and the other
half did not. The survival of both groups over the next month was com-
pared. The alternate hypothesis was “There will be increased survival of the
drug-treated group compared to the control.”
Here, the prohibitive cost of the drug meant that the manufacturer had to
be very confident that it was of real use before recommending and market-
ing it. Therefore, the risk of a Type 1 error (significantly greater survival in
the experimental group compared to the control simply by chance) when
using the 5% significance level might be considered too risky. Instead, the
researcher might decide to reduce the risk of Type 1 error by using the 1%
level and only recommend the drug if the reduction in mortality was so
marked that it was significant at this level.
Here is an example of the opposite case. A company developed a new and
extremely economical method for measuring the concentration of arsenic in
groundwater. Here, the company had to be extremely confident that their
new method gave readings that did not differ significantly from the estab-
lished method, so two thousand samples were analyzed using both. The null
hypothesis was that “The estimated concentration of arsenic does not diff er
between methods.” Here a real difference that went undetected in the trial
could be disastrous for public health, so the company statistician used a 30%
significance level to reduce the risk of getting a non-significant difference
due to chance.
The most commonly used significance level is 5%, which is 0.05. If you
decide to use a different level in an analysis, the decision needs to be made,
justified and clearly specified before the sampling or the experiment
is don e.
For a significant result, the actual probability is also important. For
example, a probability of 0.04 is not very much less than 0.05. In contrast,
a probability of 0.002 is very much less than 0.05. Therefore, even though
both are significant, the result with the lowest probability gives much
stronger evidence for rejecting the null hypothesis.
6.5 Other probability levels 59