Testing for bias · Question 44 of 60
In a disparate impact analysis for mortgages, a tester changes the age in counterfactual applications to five years. What is the problem?
1 answer is correct. Hard
Show answer
Answer
- C The examples are unrealistic, and the model may respond to them rather than to a bias
Explanation
Care must be taken that counterfactual examples are not unrealistic. Otherwise, the model may respond to the unrealistic examples themselves rather than to an underlying bias, and the result is not meaningful.