Question 680
A fine-tuned customer service model is accurate but frequently outputs unauthorized personal data from training examples. The team can modify the relevant resource but must not broaden unrelated permissions or access. A controlled test should demonstrate that controlled privacy probes disclose no disallowed source material within the review criteria. What should the engineer configure to satisfy the requirement?
Explanation
Correct Answer
Task accuracy does not establish privacy-safe behavior or absence of memorized sensitive text. A successful run shows that controlled privacy probes disclose no disallowed source material within the review criteria.
Incorrect Answers
Training optimization is not a reliable substitute for unseen-task correctness.
A single-domain average cannot prove performance for newly introduced language populations; task accuracy does not establish privacy-safe behavior or absence of memorized sensitive text.
Class imbalance can make aggregate accuracy hide harmful minority-class failures.