Deployment testing · Question 55 of 60
A team wants to compare a new model with the existing one using live data and also detect data drift and performance regressions without affecting users. Which statements are correct?
2 answers are correct. Hard
Show answer
Answer
- C It can uncover performance regressions and data drift before full deployment
- D Shadow testing compares new and old models on real data without users noticing anything
Explanation
In shadow testing a new model runs in real time in parallel with the production model, with the same requests but without affecting live responses. It allows a low-risk comparison with live data and can uncover performance regressions and data drift before full deployment. Releasing to 5% of users describes canary testing.