According to Landis and Koch (Landis J. R., & Koch G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174), the following standards are used to interpret kappa:

Kappa               Strength of agreement
< 0.2                 Poor
> 0.2 to 0.4        Fair
> 0.4 to 0.6        Moderate
> 0.6 to 0.8        Good
> 0.8 to 1           Very good

Data and Files

SPSS data files (sav) for the data in Table 2.1 and Table 2.3 can be downloaded.

An Excel file that can be used to test r, r_I, and r_P for statistical as well as compute the 95% confidence interval: ci_tests.xls

The SPSS syntax and data file in Table 2.4 to compute kappa and it standard error: data and syntax

There are several websites that can be used to compute kappa and its standard error. One such site is Lowry at Vassar and it does also provide the 95% confidence interval. Note that it gives the standard error as .0539 whereas we obtain .0537. We are not sure why there is a difference. Perhaps Lowry uses N - 1 and not N in the formula?

Go to the top.

Go to the main page of the book.