MicroCAT (tm) Testing System Page

1
Copyright (c) 1982, 1984, 1986, 1988, 1993 by Assessment Systems
Corporation

Item and Test Analysis Program -- ITEMAN (tm) Version 3.50

Item analysis for data from file D:\DATA 1.TXT

Date: 11-27-17 Time:
1:45 pm

******************** ANALYSIS SUMMARY INFORMATION

********************

Data (Input) File: D:\DATA 1.TXT

Analysis Output File: D:\DATA 1.OUTPUT
Score Output File: D:\DATA 1.SCR
Exceptions File: NONE
Statistics Output File: NONE

Scale Definition Codes: DICHOT = Dichotomous MPOINT =

Multipoint/Survey

Scale: 0
-------
Type of Scale DICHOT
N of Items 10
N of Examinees 28

***** CONFIGURATION INFORMATION *****

Type of Correlations: Point-Biserial

Correction for Spuriousness: NO

Ability Grouping: YES

Subgroup Analysis: NO

Express Endorsements As: PROPORTIONS

Score Group Interval Width: 1

 Item Statistics Alternative Statistics
----------------------- --------------------------------
---
Seq. Scale Prop. Disc. Point Prop. Endorsing Point
No. -Item Correct Index Biser. Alt. Total Low High Biser.
Key
---- ----- ------- ------ ------ ----- ----- ---- ---- ------
---

1 0-1 1.00 .00 A .00 .00 .00

B 1.00 1.00 1.00
*
C .00 .00 .00
D .00 .00 .00
E .00 .00 .00
Other .00 .00 .00

2 0-2 .86 .14 .15 A .07 .22 .00 -.27

B .86 .78 .92 .15
*
C .04 .00 .08 .10
D .04 .00 .00 -.02
E .00 .00 .00
Other .00 .00 .00

3 0-3 .54 1.00 .79 A .54 .00 1.00 .79

*
B .00 .00 .00
C .07 .22 .00 -.51
D .00 .00 .00
E .39 .78 .00 -.54
Other .00 .00 .00

4 0-4 .64 .58 .59 A .29 .67 .00 -.66

B .04 .00 .00 -.02
C .64 .33 .92 .59
*
D .00 .00 .00
E .04 .00 .08 .10
Other .00 .00 .00

5 0-5 .61 .28 .32 A .61 .56 .83 .32

*
B .07 .11 .00 -.19
C .04 .11 .00 -.24
D .00 .00 .00
E .29 .22 .17 -.15
Other .00 .00 .00

6 0-6 .89 .14 .37 A .00 .00 .00

B .89 .78 .92 .37
*
C .00 .00 .00
D .11 .22 .08 -.37
E .00 .00 .00
Other .00 .00 .00
 Item Statistics Alternative Statistics
----------------------- --------------------------------
---
Seq. Scale Prop. Disc. Point Prop. Endorsing Point
No. -Item Correct Index Biser. Alt. Total Low High Biser.
Key
---- ----- ------- ------ ------ ----- ----- ---- ---- ------
---

7 0-7 .86 .44 .51 A .07 .22 .00 -.35

B .04 .11 .00 -.35
C .04 .11 .00 -.13
D .00 .00 .00
E .86 .56 1.00 .51
*
Other .00 .00 .00

8 0-8 .25 .22 .29 A .11 .11 .00 -.16

B .00 .00 .00
C .00 .00 .00
D .25 .11 .33 .29
*
E .64 .78 .67 -.16
Other .00 .00 .00

9 0-9 .07 .08 .22 A .00 .00 .00

B .00 .00 .00
C .64 .67 .58 -.07
D .07 .00 .08 .22
*
E .29 .33 .33 -.05
Other .00 .00 .00

10 0-10 .43 .75 .69 A .43 .00 .75 .69

*
B .00 .00 .00
C .21 .33 .08 -.30
D .25 .56 .17 -.44
E .11 .11 .00 -.10
Other .00 .00 .00
MicroCAT (tm) Testing System Page 1
Copyright (c) 1982, 1984, 1986, 1988, 1993 by Assessment Systems
Corporation

Item and Test Analysis Program -- ITEMAN (tm) Version 3.50

Item analysis for data from file D:\DATA 1.TXT

Date: 11-27-17 Time:
1:45 pm

There were 28 examinees in the data file.

Scale Statistics
N of Items 10

N of Examinees 28

Mean 6.143

Variance 2.908

Std. Dev. 1.705

Skew -0.093

Kurtosis -0.790

Minimum 3.000

Maximum 9.000

Median 6.000

Alpha 0.517

SEM 1.186

Mean P 0.614

Mean Item-Tot. 0.438

Mean Biserial 0.610

Max Score (Low) 5

N (Low Group) 9

Min Score (High) 7

N (High Group) 12
 MicroCAT (tm) Testing System Page 5

Copyright (c) 1982, 1984, 1986, 1988, 1993 by Assessment Systems

Corporation

Item and Test Analysis Program -- ITEMAN (tm) Version 3.50

Item analysis for data from file D:\DATA 1.TXT

Date: 11-27-17 Time:

1:45 pm

SCALE # 0 Score Distribution Table

Number Freq- Cum

Correct uency Freq PR PCT

------- ------- ------ ---- ----

1 0 0 1 0 |

2 0 0 1 0 |

3 2 2 7 7 |#######

4 4 6 21 14 |##############

5 3 9 32 11 +###########

6 7 16 57 25 |######################

7 6 22 79 21 |####################

8 3 25 89 11 |###########

9 3 28 99 11 |###########

10 0 28 99 0 +

|----+----+----+--

5 10 15 20 25

Percentage of Examinees
 DAILY TEST

Alpha (Reliability) for this question is 0,517. It means that all question is good enough /
average. The learners’ score is quite dependable. It means these questions is reliable since the
result is stabil/ sufficient. So, all the question is reliable to be kind of test to the learners.

A. THE ANALYSIS OF EACH ITEMS (10 NUMBERS)

1. Prop Correct = 1.00 (very easy / needs dropping or total revising)

Point Biserial = - (very low / needs dropping or total revising)
So, question number 1 is need dropping or total revising since the question and
discriminating power can be answered by all the students both smart and
unintellegent.
Saran:

2. Prop Correct = 0,86 (very easy / needs dropping or total revising)

Point Biserial = 0,15 (very low / needs dropping or total revising)
So, question number 2 is need dropping or total revising (sama kaya nomor satu).
Saran:

3. Prop Correct = 0,54 (average / good)

Point Biserial = 0,79 (high / very good)
So, question number 3 is good since it can

4. Prop Correct = 0,64 (average / good)

Point Biserial = 0,59 (high / very good)
So, question number 4 is good since it can

5. Prop Correct = 0,61 (average / good)

Point Biserial = 0,32 (quite average / without revision)
So, question number 5 is good since it can......
 6. Prop Correct = 0,89 (very easy / needs dropping or total revising)
Point Biserial = 0,37 (quite average / without revision)
So, question number 6 is need dropping or total revising since it can make........

7. Prop Correct = 0,86 (easy / needs revising)

Point Biserial = 0,51 (high / very good)
So, question number 7 is need revising since..............
Saran..............

8. Prop Correct = 0,25 (difficult / needs revising)

Point Biserial = 0,29 (low / needs revising)
So, question number 8 is need revising since it makes.................
Saran................

9. Prop Correct = 0,07 (very difficult / needs total revising)

Point Biserial = 0,22 (low / needs revising)
So, question number 9 is need dropping or total revising since it makes.............
Saran..............

10. Prop Correct = 0,43 (average / good)

Point Biserial = 0,69 (high / very good)
So, question number 10 is good since it makes

B. THE EXAMPLE OF SOME QUESTIONS THAT HAVE CHOOSEN AS

SAMPLES
- Good questions are consist of 4 questions, they are: number 3, 4, 5, and 10.

Number 10 :
a. Item Statistics
Prop Correct = 0,43 (average / good)
Point Biserial = 0,69 (high / very good)
 The Question:

- Easy/needs revising questions are consist of 2 questions they are number 7 and 8.
Number 7:
a. Item Statistics
Prop Correct = 0,86 (easy / needs revising)
Point Biserial = 0,51 (high / very good)

The Question:

- Needs dropping are consist of 4 questions, they are: number 1, 2, 6 and 9.

The Question:
 C. THE PERCENTAGE OF THE ANALYSIS OF THE QUESTIONS

Persentages

20%

40%
Good
Need Revising
Need Dropping or Total Revising

40%

The explanation of percentage of the items

1. Good (4 numbers)
Number : 3, 4, 5, and 10
4
Percentage : 10 x 100% = 40%

2. Need Revising
Easy (one number)
Number :7
1
Percentage : 10 x 100% = 10%

Difficult (one number)

Number :8
1
Percentage : 10 x 100% = 10%

So the total is 20%

3. Need Dropping or Total Revising
a. Too easy (3 numbers)
 Number : 1, 2, and 6
3
Percentage : 10 x 100% = 30%

b. Too difficult (one number)

Number :9
1
Percentage : 10 x 100% = 10%

So the total is 40%

D. The Percentage of The Alternatives
1. Good Key Answers (22 numbers)
Number : 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
10
Percentage : 50 x 100% = 20%

2. Bad Key Answers (0 numbers)

3. Good Distractions (24 distractions)

24
Percentage : 50 x 100% = 48%

4. Bad Distractions (16 distractions)

16
Percentage : 50 x 100% = 32%

The Diagram of The Alternative Percentage

27%
33%
Good Key Answer
Bad Key Answer
Good Distractions
Bad Distractions
0%
40%
CONCLUSION
1. There were 28 examinees and there are 10 questions in the data file.

2. Good.
There are some questions that are categorized as good questions because those
questions are answered by most of smart students. For example, in number 10 the
percentage of smart students who choose the correct answer is 75% while the
percentage of unintelligent students is 0%.

3. Needs revising.
There are some questions that must be revised is number 7 and 8. It must be revised
because smart and unintelligent students’ answers are not much different.

4. Needs dropping.
There are some questions that must be dropped such as, number 1, 2, 6 and 9. It
must be dropped because the questions are too easy and too difficult. If the question
is too easy the percentage of the smart students who answer the question correctly
is more than the percentage of unintelligent students. For example, in number 6 the
percentage of the smart students who answer the question correctly is 92% while
the percentage of unintelligent students is 76%.
If the question is too difficult, it means that there is only a little student who can
answer the question directly. For example, in number 9 the percentage of smart
students who can answer the question correctly is 8%, while the percentage of
unintelligent students is 0%.

REFERENCES
 E. Gronlund, Norman and Waugh, C. Keith. 2009. Assessment of Student Achievement.
New Jersey: Pearson.

User’s Manual for the ITEMAN Conventional Item Analysis Program Second Edition,
32-bit Windows Version. Assessment Systems Corporation.