difficult to control the forces of nuisance variation
For these reasons, it is much more desirable to conduct an experimental program through a series of smaller, often
interconnected experiments. This provides the opportunity to modify hypotheses about the state of affairs concerning the
situation at hand, to discard variables that are shown to be unimportant, to change the region of study of some or all of the
variables, and/or to define and include other measures of process performance. Experimental designs that can be
combined sequentially are very useful in this regard. This is often referred to as the sequential assembly of experimental
designs.
Revelation of Variable Effects. Often, the variables of importance are not clearly known a priori. It is desirable to be
able to study several variables together but to independently observe the effect of a change in each one of the variables.
Furthermore, it may be deemed important to know if such a variable effect varies with the conditions of the process, that
is, when other variables take on varying levels. An arrangement of the tests is called a design, which provides for the
opportunity to learn much about the relationships between the variables and the response. In particular:
• The effect of changing any of the variables alone can be observed
• The possibility th
at the effects measured above can vary as conditions of other variables vary can be
observed, that is, the existence of variable interactions
System Noise/Variation
The experimental study of any phenomenon is made difficult by the presence of noise or experimental error. Many
factors, not directly under study, are varying over the course of the experiment. These are often referred to as the forces of
common cause system variation. Such variation may cloud or mask the effect of change of the factors under study in an
experiment. The forces of noise or variation can be better understood or mitigated by several approaches, some of which
are strictly experimental design issues.
Statistical Control/Stability Analysis. If the phenomenon under study is already a viable and ongoing process, the
pursuit of improvement opportunities through experimentation can be considerably enhanced by employing the
techniques of statistical process control. In this way, spurious or sporadic sources of variation can be identified and,
through remedial action, removed. Achievement of a stable process will greatly contribute to the ability to more readily
observe the effects of purposeful process change. Thus, continued study will further enhance the ability to observe the
persistence of changes that might be introduced. Once a process is stabilized, continued attack on the common cause
system will lead to a progressively quieter process, further heightening the ability to observe the forces of purposeful
process change through experimentation.
Experimental Design Strategies. In many situations, the notion of a stable, ongoing process has little meaning. In
the early stages of product or process design or prototype or pilot-plant testing, a stable, consistent process is not present.
It is perhaps for this reason (among others) that the body of knowledge known as experimental design was cultivated.
Under such situations, the following factors are significant:
• Attempt to identify major sources of variation and take action to ensure that t
out from the comparisons made within an experiment.
The technique of blocking is useful for this
purpose
•
Counteract the forces of unknown systematic variation over the period of the experiment by
randomization of the tests so that
such variation is uniformly and randomly distributed across the trials
conducted
•
Include replication in the experimental test plan. Multiple tests at the same conditions will provide
comparisons that directly measure the amount of variation/experimental error
•
Include confirmatory testing as part of the experimental strategy. It will be important that additional
trials are run under specific conditions determined from the analysis to verify the improvement
opportunities revealed from the experiment