Dataset and label checks · Question 18 of 60

What happens in multiple annotation?

1 answer is correct. Easy

Show answer

Answer

  • D Data points are labeled independently by several annotators and the results are compared

Explanation

In multiple annotation, several annotators label the data points independently, and the results are compared using a form of back-to-back testing. Disagreements highlight defects that need investigation and resolution. Agreement is measured as inter-annotator agreement (IAA).

Certifications & exams

Which exam comes next?

You can already practise for 19 exams, and 21 are up for a vote. See all certifications with their official information, cast your vote or suggest your exam.

See all certifications