Question 250
An employee-facing model begins inferring health conditions from ordinary workplace messages. A risk owner is documenting the concern for management. What would be the strongest result to verify before closing the finding?
Explanation
Correct Answer
The key evidence is the observed result: tests verify sensitive inferences are not produced or retained outside permission. It is relevant because deployment changed from assistance into sensitive profiling without authorization.
Incorrect Answers
That observation would verify a control associated with: Operational success metrics omitted foreseeable adverse societal impacts. It does not establish the needed acceptance outcome. The direct evidence is “Tests verify sensitive inferences are not produced or retained outside permission”, testing: Deployment changed from assistance into sensitive profiling without authorization.
“Post-incident results show the harm reduced and actions demonstrably closed” could occur while the stated failure remains unresolved. It tests: Post-incident results show the harm reduced and actions demonstrably closed. The required validation instead is “Tests verify sensitive inferences are not produced or retained outside permission”, because deployment changed from assistance into sensitive profiling without authorization.
That observation would verify a control associated with: Updated model versions pass required checks before authorized release. It does not establish the needed acceptance outcome. The direct evidence is “Tests verify sensitive inferences are not produced or retained outside permission”, testing: Deployment changed from assistance into sensitive profiling without authorization.