Question 640
A scholarship screening tool rejects qualified applicants from one demographic group at an unusually high rate. The team wants to distinguish a targeted fix from a generic policy statement. What failure should the review team record as the primary cause?
Explanation
Correct Answer
Aggregate accuracy hid a potential disparity for a protected group. This explains the observed weakness and why the proposed action matters: compare group-specific error rates and examine the data and decision thresholds before continued use.
Incorrect Answers
The proposed cause describes a different problem: probabilistic predictions were mistaken for exact rules despite input sensitivity. In this case, the primary issue is that aggregate accuracy hid a potential disparity for a protected group.
The proposed cause describes a different problem: insufficient isolation of confidential input and retrieval data creates privacy and security harm. In this case, the primary issue is that aggregate accuracy hid a potential disparity for a protected group.
The proposed cause describes a different problem: accountability cannot be delegated to an algorithm without an operational review mechanism. In this case, the primary issue is that aggregate accuracy hid a potential disparity for a protected group.