Dataset and label checks · Question 38 of 60
What can low inter-annotator agreement (IAA) scores indicate?
3 answers are correct. Medium
Show answer
Answer
- C Defects in the labeling guidelines
- D Poor annotation
- E Ambiguous data
Explanation
Low IAA scores can indicate defects in labeling guidelines, ambiguous data or poor annotation. IAA is measured in multiple annotation, for example with Cohen's Kappa or percentage agreement.