Question 560
A document-answering agent is redeployed with different retrieval settings but monitors only the LLM response token count. A release review requires the engineer to demonstrate the expected behavior after the change. For acceptance, the reviewer must confirm that the monitor identifies the retrieval regression independent of token use. Which change most directly addresses the observed behavior?
Explanation
Correct Answer
Token volume does not establish fidelity of retrieved sources. A successful run shows that the monitor identifies the retrieval regression independent of token use.
Incorrect Answers
The alternative is relevant when an agent's output quality varies across application tenants but monitoring reports only one global average; token volume does not establish fidelity of retrieved sources.
Predeployment quality does not guarantee postdeployment groundedness after dependency changes.
Quality alerts need trace-level provenance for diagnosis; token volume does not establish fidelity of retrieved sources.