Dataset and label checks · Question 59 of 60
A team wants to ensure label quality throughout the project. Which combination is often most effective?
1 answer is correct. Hard
Show answer
Answer
- B Early expert reviews for guidelines, then IAA scores from multiple annotation, later model-based approaches
Explanation
A combination of approaches is often most effective: expert reviews help to establish clear labeling guidelines early on, IAA scores from multiple annotation then refine the labeling process, and as the model continues to develop, model-based approaches identify further potential label defects.