Comparative testing · Question 53 of 60

A city wants to check whether an update to its AI-based traffic routing system improves journeys. Which approach fits?

1 answer is correct. Hard

1. A An A/B test, for example with the average travel time of both variants in two comparable weeks
2. B A review of the model documentation before and after the update by the traffic authority
3. C A back-to-back test with a pseudo-oracle that uses exactly the same code as the update
4. D A one-off single test at a selected intersection during rush hour