Question 510
A prompt test set consists only of short, unambiguous queries but production users submit long contradictory documents. For acceptance, the reviewer must confirm that the candidate handles controlled long and conflicting-context cases within policy. What is the best next action for this Azure AI workload?
Explanation
Correct Answer
A narrow test distribution misses important real-world document reasoning failures. On retest, the candidate handles controlled long and conflicting-context cases within policy.
Incorrect Answers
Testing on the same examples used during optimization inflates apparent generalization.
A model may fabricate answers if it is never tested without supporting context.
The option fits a situation where a technical assistant supports four languages but its test set contains only English requests. It does not add boundary-length and contradictory-evidence scenarios to the evaluation dataset.