Linked Questions

Popular Questions

Inter-rater agreement for one item

Asked by At

I asked annotators to give binary ratings to multiple items; the objective is to calculate the inter-rater agreement on one item for each rating (0 and 1). Can Krippendorff's alpha be used for this? I could not find any resource on using Krippendorrf's alpha on a single item. The solution for a similar question ( is present but it uses simple percentage agreement, which I cannot use for academic publication.

Related Questions