ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

ANOVA can be used to compare more than two means.

Thus, ANOVA is a procedure used to test the null hypothesis that the mean of 3 or more
populations are equal.

We may compare the means of several treatment groups and a control group.
With ANOVA, because several sample means are usually being compared, once a null
hypothesis has been rejected we need a follow-on, or post hoc, procedure.
This is because although ANOVA examines all sample means at once, it is possible that some
pairs of means may not be significantly different from one another, even though when all means
are taken together in their entirety, the null hypothesis may be rejected.

F distribution

1. The F distribution is continuous and skewed to the right.

2. The F distribution has 2 numbers of degree of freedom: df for the numerator and df for
the denominator. Example: df(8, 12)
3. The units of an F distribution are non-negative.

Assumptions:

1. The populations are normally distributed.

2. The populations have the same variance (or standard deviation).
3. The samples drawn from different populations are random and independent.

Test Statistic for One-Way ANOVA

x = the score
k = number of different samples treatments
ni = size of sample i
Ti = sum of elements in each group (sum of values in sample i)
n = number of elements in each group (number of values in all samples = n1 + n2 + n3 + …)
Σ x = sum of values in all samples = T1 + T2 + T3 + …
Σ x2 = sum of squares of the values in all samples
N = Total number of elements in all the groups

x =
x1 + x 2 + ... + x n = grand mean (overall mean)
n
Method 1

1
 Σ n( x − x ) 2
MSB =
k −1
2
Σ( n −1 ) s
MSW =
Σ( n −1)

MSB
F=
MSW

Method 2

2
(Σx)
SS(Total) = Σ x -
2

N
2 2 2 3
Σ Ti (Σx)
2
T T2 T3
( + + + . . . )-
1 (Σx)
2
SS(Between) = − =

n N n1 n2 n3 N

Total sum of squares = SS(Total) = SS(Between) + SS(Within)

SS (Within) = SS(Total) – SS(Between)

2 2 3
SS(Within) = Σ x - (2
T 1 + T2 + T3 + . . . )
n1 n2 n3

Example 1.

Different techniques are used in teaching Calculus to three groups of randomly selected students.
At the end of the semester, the students are given a standardized test and the results are shown as
below.
Method I Method II Method III
48 55 84
73 85 68
51 70 95
65 69 74
87 90 67

Test the claim that the three techniques are equally effective at 5% significance level.

2
Solution

Ho : The means of all groups are equal

H1 : Not all samples are equal.

dfnumerator = k – 1 = 3 – 1 = 2
dfdenominator = N – k = 15 – 3 = 12
From F-distribution table, the critical value = 6.9266

Method 1

T=Σ x 324 369 388

Mean 64.8 73.8 77.6
Σ x2 22028 28011 30670
Variance 258.2 194.7 140.3

48 + 73 + ... + 67
Grand mean, x = = 72 .07
15

Σ n( x − x ) 2 5(64.8 − 72.07 )2 + 5(73.8 − 72.07 )2 + 5(77.6 − 72.07 )2

MSB = = = 216.07
k −1 3−1

Σ( n −1 ) s 2 258 .2(5 −1) +194 .7(5 −1) +140 .3(5 −1)

MSW = = = 197.73
(5 −1) + (5 −1) + (5 −1)
Σ( n −1)

MSB 216 .07

F= = = 1.09
MSW 197 .73

Method 2

T1 = 48 + 73 + 51 + 65 + 87 = 324
T2 = 55 + 85 + 70 + 69 + 90 = 369
T3 = 84 + 68 + 95 + 74 + 67 = 388
Σ x2 = 482 + 732 + … 672 = 80 709

2
(Σx)
2
(1081 )
SS(Total) = Σ x2 - = 80709 - = 2804.9333
N 15

3
 2
Σ Ti (Σx)
2
324
2
369
2
388
2
(1081 )
2
SS(Between) = − N
=(
5
+
5
+
5
)-
15
=

n
432.2333

SS ( Between ) 432 .2333

Variance between samples, MSB = = = 216.0667
k −1 3 −1

SS (Within )
Variance within samples, MSW = = 197.73333
15 − 3

MS B 216 .0667
F= = = 1.09
MSW 197 .73333
Conclusion: Since 1.09 < 6.9266, do not reject Ho at α = 0.05. There is no difference in the
techniques used.

Example 2.