Annotation reliability · Cut and Break Verbs German: Elicitation with Video Stimulus
Calculated from published demonstration Curator annotations only. Adjudicated values are never used. At least two non-empty ratings are required per field and item.
| Field | Jointly annotated items | Ratings used | Exact agreement | Krippendorff’s α |
|---|---|---|---|---|
| Agent_Do | 50 | 250 | 26.0% | 0.446 |
| Happened_Obejct | 50 | 250 | 30.0% | 0.472 |
Interpretation note
Exact agreement is the share of jointly annotated items with identical ratings. Krippendorff’s α corrects for agreement expected from the category distribution.