Comparative testing · Question 59 of 60
A team wants, on the one hand, to find out which of two model variants has the better accuracy and, on the other, to detect defects in a new implementation. Which techniques fit each purpose?
2 answers are correct. Hard
Show answer
Answer
- B Back-to-back testing with a pseudo-oracle for detecting defects
- D A/B testing for the statistical comparison of the two variants based on the performance metrics
Explanation
A/B testing compares two variants of the same ML system using functional performance metrics and statistical techniques to determine the better one. Back-to-back testing uses an alternative version as a pseudo-oracle and is used to detect defects.