Question 670
A generator creates synthetic Q&A pairs from a policy document but makes up nonexistent exceptions. A release review requires the engineer to demonstrate the expected behavior after the change. The sign-off condition is that all accepted synthetic exceptions have a source-linked justification and reviewer approval. What should the release engineer do before proceeding?
Explanation
Correct Answer
Generated question-answer pairs can hallucinate rules absent from the source document. A successful run shows that all accepted synthetic exceptions have a source-linked justification and reviewer approval.
Incorrect Answers
Skewed synthetic labels can teach excessive refusal or over-acceptance patterns.
One invalid example can break the training ingestion contract despite otherwise useful content.
Synthetic-looking text can still reveal real personal data when seeded from raw logs; generated question-answer pairs can hallucinate rules absent from the source document.