Question 690
At the Kingsford commercial bank, a small business loan assistant recommends significantly worse offers to equally qualified applicants from one demographic group. Which underlying issue most directly explains this situation?
Explanation
Correct Answer
The problem stems from the fact that average model performance can hide unjustified differences affecting protected groups. A correct solution would evaluate comparable outcomes across relevant groups and correct discriminatory patterns and check that a controlled audit finds and documents disparity corrections without exposing personal data. This result addresses the stated challenge at the Kingsford commercial bank.
Incorrect Answers
The proposed cause is relevant to privacy minimization, but it does not explain why average model performance can hide unjustified differences affecting protected groups in the reported case. For the Kingsford commercial bank, the direct corrective action is to evaluate comparable outcomes across relevant groups and correct discriminatory patterns.
An irreversible action is much riskier than generating a reviewable draft. That is not the mechanism that accounts for the stated failure at the Kingsford commercial bank.
The case does not describe the failure mode involving prompt injection and tool abuse. Its core issue is that average model performance can hide unjustified differences affecting protected groups. For the Kingsford commercial bank, the direct corrective action is to evaluate comparable outcomes across relevant groups and correct discriminatory patterns.