Question 260
A triage model yields different confidence scores for nearly identical customer complaints, but staff treat each score as a deterministic fact. The responsible group has opened a targeted corrective-action review. Which follow-up control should the system owner maintain?
Explanation
Correct Answer
Review calibration and borderline predictions after significant model changes. This provides continuing control over the recurring risk that probabilistic predictions were mistaken for exact rules despite input sensitivity.
Incorrect Answers
This safeguard addresses a different recurring problem: engagement optimization did not account for downstream societal and individual harms. Here, the risk to control is that probabilistic predictions were mistaken for exact rules despite input sensitivity.
This safeguard addresses a different recurring problem: real-world distribution shifts undermine reliability outside the development benchmark. Here, the risk to control is that probabilistic predictions were mistaken for exact rules despite input sensitivity.
This safeguard addresses a different recurring problem: foreseeable misuse and prompt manipulation were not adequately evaluated. Here, the risk to control is that probabilistic predictions were mistaken for exact rules despite input sensitivity.