The Inter-Annotator Agreement

Perhaps the first Landis and Koch,[13] the values < 0 were not compliant and 0-0.20 as low, 0.21-0.40 as fair, 0.41-0.60 as moderate, 0.61-0.80 as substantial, and 0.81-1 almost perfect. Kappa is an index that takes into account the observed concordance with a basic agreement. However, researchers should carefully consider whether Kappa`s basic agreement is relevant to each research question. Kappas Baseline is often described as the agreement by chance, which is only partially correct. The Basic Kappa Agreement is the agreement that would be expected due to random allocation, given the quantities indicated by the marginal amounts of the square contingency table. Therefore, Kappa = 0, if the observed allocation is apparently random, regardless of the quantitative opinion limited by marginal amounts. .

Publicerat i Okategoriserade