Академический Документы
Профессиональный Документы
Культура Документы
Analysis of Variance
Chap 11-1
Chapter Goals
After completing this chapter, you should be able
to:
Chap 11-2
Chapter Overview
Analysis of Variance (ANOVA)
One-Way
ANOVA
Randomized
Complete
Block ANOVA
Two-factor
ANOVA
with replication
F-test
F-test
TukeyKramer
test
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Fishers Least
Significant
Difference test
Chap 11-3
Chap 11-4
Assumptions
Populations are normally distributed
Populations have equal variances
Samples are randomly and independently drawn
Chap 11-5
Analyzed by
Chap 11-6
H0 : 1 2 3 k
Chap 11-7
One-Factor ANOVA
H0 : 1 2 3 k
HA : Not all i are the same
All Means are the same:
The Null Hypothesis is True
(No Treatment Effect)
1 2 3
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-8
One-Factor ANOVA
H0 : 1 2 3 k
(continued)
or
1 2 3
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
1 2 3
Chap 11-9
Chap 11-10
Chap 11-11
Variation Due to
Factor (SSB)
Chap 11-12
ni
SST ( xij x)
Where:
i1 j1
Chap 11-13
Total Variation
(continued)
Response, X
X
Group 1
Group 2
Group 3
Chap 11-14
SSB ni ( x i x )
Where:
i1
Chap 11-15
Between-Group Variation
k
SSB ni ( x i x )
i1
Variation Due to
Differences Among Groups
SSB
MSB
k 1
Mean Square Between =
SSB/degrees of freedom
Chap 11-16
Between-Group Variation
(continued)
SSB n1 ( x1 x ) n2 ( x 2 x ) ... nk ( x k x )
2
Response, X
X3
X1
Group 1
Group 2
X2
Group 3
Chap 11-17
SSW
i1
nj
j1
( xij xi )
Where:
Chap 11-18
Within-Group Variation
k
SSW
i1
nj
j1
( xij xi )2
SSW
MSW
Nk
Mean Square Within =
SSW/degrees of freedom
i
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-19
Within-Group Variation
(continued)
Response, X
X3
X1
Group 1
Group 2
X2
Group 3
Chap 11-20
Between
Samples
Within
Samples
Total
SS
df
MS
F ratio
k-1
SSB
MSB =
k-1
MSB
F=
MSW
SSW
N-k
SSW
MSW =
N-k
SST =
SSB+SSW
N-1
SSB
k = number of populations
N = sum of the sample sizes from all populations
df = degrees of freedom
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-21
One-Factor ANOVA
F Test Statistic
H0: 1= 2 = = k
Test statistic
MSB
F
MSW
Degrees of freedom
df1 = k 1
df2 = N k
(k = number of populations)
(N = sum of sample sizes from all populations)
Chap 11-22
Chap 11-23
One-Factor ANOVA
F Test Example
You want to see if three
different golf clubs yield
different distances. You
randomly select five
measurements from trials on
an automated driving
machine for each club. At the
.05 significance level, is there
a difference in mean
distance?
Club 1
254
263
241
237
251
Club 2
234
218
235
227
216
Club 3
200
222
197
206
204
Chap 11-24
Club 2
234
218
235
227
216
Club 3
200
222
197
206
204
Distance
270
260
250
240
230
220
X1
X2
210
200
x 227.0
190
2
Club
X
X3
Chap 11-25
Club 2
234
218
235
227
216
Club 3
200
222
197
206
204
x1 = 249.2
n1 = 5
x2 = 226.0
n2 = 5
x3 = 205.8
n3 = 5
x = 227.0
N = 15
k=3
2358.2
F
25.275
93.3
Chap 11-26
Test Statistic:
MSB 2358.2
F
25.275
MSW
93.3
Critical
Value:
F = 3.885
= .05
Do not
reject H0
Reject H0
F.05 = 3.885
Decision:
Reject H0 at = 0.05
Conclusion:
There is evidence that
at least one i differs
F = 25.275
from the rest
Chap 11-27
Count
Sum
Average
Variance
Club 1
1246
249.2
108.2
Club 2
1130
226
77.5
Club 3
1029
205.8
94.2
ANOVA
Source of
Variation
SS
df
MS
Between
Groups
4716.4
2358.2
Within
Groups
1119.6
12
93.3
Total
5836.0
14
F
25.275
P-value
4.99E-05
F crit
3.885
Chap 11-28
e.g.: 1 = 2 3
Done after rejection of equal means in ANOVA
1= 2
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
x
Chap 11-29
CriticalRange q
MSW 1 1
2 ni n j
where:
q = Value from standardized range table
with k and N - k degrees of freedom for
the desired level of
MSW = Mean Square Within
ni and nj = Sample sizes from populations (levels) i and j
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-30
Club 2
234
218
235
227
216
Club 3
200
222
197
206
204
q 3.77
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-31
MSW 1 1
93.3 1 1
3.77
16.285
2 ni n j
2 5 5
4. Compare:
x1 x 2 23.2
x1 x 3 43.4
x 2 x 3 20.2
Chap 11-32
Tukey-Kramer in PHStat
Chap 11-33
Chap 11-34
Chap 11-35
SSBL k( x j x )
j 1
Where:
Chap 11-36
Chap 11-37
Mean Squares
SSBL
MSBL Mean squareblocking
b 1
MSB Mean square between
SSB
k 1
SSW
MSW Mean square within
(k 1)(b 1)
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-38
SS
df
MS
F ratio
Between
Blocks
SSBL
b-1
MSBL
MSBL
MSW
Between
Samples
SSB
k-1
MSB
MSB
MSW
Within
Samples
SSW
(k1)(b-1)
MSW
SST
N-1
Total
k = number of populations
b = number of blocks
Chap 11-39
Blocking Test
H0 : b1 b2 b3 ...
HA : Not all block means are equal
MSBL
F=
MSW
Blocking test:
df1 = b - 1
df2 = (k 1)(b 1)
Reject H0 if F > F
Chap 11-40
F=
MSB
MSW
df1 = k - 1
df2 = (k 1)(b 1)
Reject H0 if F > F
Chap 11-41
Fishers
Least Significant Difference Test
e.g.: 1 = 2 3
Done after rejection of equal means in randomized
block ANOVA design
1= 2
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
x
Chap 11-42
2
MSW
b
where:
t/2 = Upper-tailed value from Students t-distribution
for /2 and (k -1)(n - 1) degrees of freedom
MSW = Mean square within from ANOVA table
b = number of blocks
k = number of levels of the main factor
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-43
2
MSW
b
Compare:
Is xi x j LSD ?
If the absolute mean difference
is greater than LSD then there
is a significant difference
between that pair of means at
the chosen level of significance.
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
x1 x 2
x1 x 3
x2 x3
etc...
Chap 11-44
Two-Way ANOVA
Chap 11-45
Two-Way ANOVA
(continued)
Assumptions
Chap 11-46
Two-Way ANOVA
Sources of Variation
Two Factors of interest: A and B
a = number of levels of factor A
Chap 11-47
Two-Way ANOVA
Sources of Variation
SST = SSA + SSB + SSAB + SSE
SSA
Variation due to factor A
SST
Total Variation
SSB
Variation due to factor B
SSAB
N-1
SSE
(continued)
Degrees of
Freedom:
a1
b1
(a 1)(b 1)
N ab
Chap 11-48
SST ( x ijk x )
i 1 j 1 k 1
SS A bn ( x i x )
i1
SSB an ( x j x )2
j 1
Chap 11-49
Sum of Squares
Interaction Between
A and B:
SS
AB
n ( x ij x i x j x )2
i 1 j1
SSE ( x ijk x ij )
i1 j1 k 1
Chap 11-50
where:
b
xi
j 1 k 1
x
i 1 j1 k 1
ijk
ab n
(continued)
Grand Mean
ijk
bn
xj
x
i1 k 1
an
ijk
x ijk
x ij
Mean of each cell
k 1 n
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
SS AB
Mean square interactio n
(a 1)(b 1)
SSE
MSE Mean square error
N ab
Business Statistics: A Decision-Making Approach, 6e 2005 Prentice-Hall, Inc.
Chap 11-52
Two-Way ANOVA:
The F Test Statistic
H0: A1 = A2 = A3 =
H0: B1 = B2 = B3 =
HA: Not all Bi are equal
MS A
F
MSE
Reject H0
if F > F
MSB
F
MSE
Reject H0
if F > F
MS AB
F
MSE
Reject H0
if F > F
Chap 11-53
Two-Way ANOVA
Summary Table
Source of
Variation
Sum of
Squares
Degrees of
Freedom
Mean
Squares
F
Statistic
Factor A
SSA
a1
MSA
MSA
MSE
Factor B
SSB
b1
AB
(Interaction)
SSAB
(a 1)(b 1)
Error
SSE
N ab
Total
SST
N1
= SSA /(a 1)
MSB
= SSB /(b 1)
MSAB
= SSAB / [(a 1)(b 1)]
MSB
MSE
MSAB
MSE
MSE =
SSE/(N ab)
Chap 11-54
Chap 11-55
Examples:
Interaction vs. No Interaction
No interaction:
Interaction is
present:
Factor B Level 3
Factor B Level 2
Factor A Levels
Mean Response
Factor B Level 1
Mean Response
Factor B Level 1
Factor B Level 2
Factor B Level 3
Factor A Levels
2
Chap 11-56
Chapter Summary
Chap 11-57