ScoreRel CI

Computation of Reliability Coefficient Two-Tailed Confidence Intervals

Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham
1530 3rd Ave S., 140J RPHB, Birmingham, AL 35294-0022
barnette @ uab.edu

Reliability Score Confidence Interval Estimates for: Cronbach's Alpha, Pearson r

type coefficients (test-retest, alternate forms, etc.), Split-half coefficients,
and unweighted Cohen's Kappa for the 2 by 2 model.

This software is available at no charge to the user. Sharing with others is encouraged.
All that is requested is that if this software is used to determine confidence intervals
for reports or publications, the following reference be included in the References:

Barnette, J.J. (2005). ScoreRel CI: Software for computation of commonly used score
reliability coefficients. Educational and Psychological Measurement, 65, 980-983.

In the following programs, enter data into the yellow cells

Results will be seen in the light blue cells

Click on one of the Tabs BELOW to go to the desired page.

 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham

Confidence Interval for Cronbach's Alpha

Input number of subjects (n), number of items (i), observed Alpha, and
desired CI Probability
CI Prob. (.500-.999)
n ( ≥ 5) i ( ≥ 3) Obs. Alpha (.95, .99, etc.)
50 75 0.8200 0.9500
0.025 0.975
Upper and Lower Confidence Interval Limits
CI lower CI upper
1.437695 0.7412 ≤ α ≤ 0.8843 0.642613

Click on one of the Tabs BELOW to go to the desired page.

 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham

Confidence Interval for Pearson-Based Coefficient (test-retest, alt. forms)

Input number of subjects (n, number the r value based on), the reliability
coefficient, and desired CI probability.

CI Prob. (.500-.999)
n ( ≥ 5) Obs. Pearson r (.95, .99, etc.)
20 0.8000 0.9500
1.098612 0.242536 1.959964
Upper and Lower Confidence Interval Limits
0.623251 CI lower CI upper 1.573973
0.5534 ≤ ρ ≤ 0.9177

Click on one of the Tabs BELOW to go to the desired page.

 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham

Confidence Interval for Split-Half Coefficients

Input number of subjects (n) and the desired CI probability.
You may enter the uncorrected Pearson r or the Spearman-Brown adjusted
coefficient. Enter which of these you wish to enter, and enter 0 for the other
value. If non-zero entries are made for both coefficients, Spearman-Brown
entry takes precedence and all output will relate to that entry.

Uncorrected Spearman-Brown CI Prob. (.500-.999)

n ( ≥ 5) Pearson r Coefficient (.95, .99, etc.)
20 0.8500 0.0000 0.9000
SB r 0.918919 r 0.85
Uncorrected Estimated Reliability Coefficient
Pearson r Spearman-Brown Prophecy
0.8500 0.9189
1.256153 0.242536 1.644854
Upper and Lower Confidence Interval Limits
0.857217 CI lower CI upper 1.655088
0.694821 0.8199 ≤ ρs-h ≤ 0.9635 0.929553

Click on one of the Tabs BELOW to go to the desired page.

 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham

Confidence Interval for Unweighted Cohen's Kappa in 2 by 2

Input frequencies in each of four cells and desired CI probability

Reviewer 2
Rating
1 0 Total
Reviewer 1 1 20 5 25 p(Agree)= 0.8250
Rating 0 2 13 15 p(Chance)= 0.5125
Total 22 18 40
k=
CI Prob. (.500-.999) Est. Kappa= 0.6410 se=
(.95, .99, etc.) Standard Error= 0.1562
0.9500

Upper and Lower Confidence Interval Limits

CI lower CI upper
0.3348 ≤ Κ ≤ 0.9472 0.975 1.95996

0.55 0.45
Click on one of the Tabs BELOW to go to the desired page.

0.7752
0.324336 0.54 0.176155
0.4817 0.419708
 0.625
0.375

0.156232
0.156232
 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham
1530 3rd Ave S., 140J RPHB, Birmingham, AL 35294-0022
barnette @ uab.edu

Limits on Inputs:
Limits for number of subjects: 5 or more
Limits for number of items (Cronbach Alpha): 3 or more
Limits for score reliability coefficient: -0.99 to +.99 (typical value is 0 to +1)
Limits for Confidence Interval probability: .500 to .999

Suggested Limits on Outputs:

This program returns output that is specific to the distribution used and entries. Thus, it is possible to
to get values that are below -1 or above +1, typically considered outside the theoretical range of
reliability values of 0 to +1.
If result is less than 0, 0 is the suggested value.
If result is greater than +1, +1 is the suggested value.

Click on one of the Tabs BELOW to go to the desired page.

 ScoreRel CI
Computation of Reliability Coefficient Two-Tailed Confidence Intervals
Programmed by Jack Barnette, PhD, Department of Biostatistics
School of Public Health, University of Alabama at Birmingham
1530 3rd Ave S., 140J RPHB, Birmingham, AL 35294-0022
barnette @ uab.edu

References:

These programs are based on distribution theory and equations referenced in:

Fan, X. & Thompson, B. (2001). Confidence intervals around score reliability coefficients, please:
An EPM Guidelines Editorial, Educational and Psychological Measurement, 61, 517-532.

Feldt, L.S., Woodruff, D.J., & Salih, F.A. (1987). Statistical inference for coefficient alpha.
Applied Psychological Measurement, 11, 93-103.

Fleiss, J.L. (1981). Statistical methods for rates and proportions (2nd ed.). New York:
John Wiley, 38-46.

Click on one of the Tabs BELOW to go to the desired page.