Fundamentals of testing AI-based systems · Question 43 of 60
A tester is asked to write test cases in advance for all future behaviors of an adaptive recommender system. What is there to say about this?
3 answers are correct. Hard
Show answer
Answer
- A An automated test suite for the core functionality that runs when significant changes occur makes sense
- B New behaviors cannot always be predicted and therefore can neither be tested in advance nor prepared with test cases
- C In addition, it can be checked that performance does not degrade beyond a threshold
Explanation
Unpredictable behaviors of adaptive systems cannot be tested in advance. Instead, a useful approach is an automated test suite focused on the core functionality that is executed when significant changes occur and verifies that adaptations are safe, as well as testing that performance has not degraded beyond a threshold, in response to changes or as part of ongoing monitoring.