Question 590
A model endpoint sometimes fails after a tool exception but logging records only successful calls. A release review requires the engineer to demonstrate the expected behavior after the change. A controlled test should demonstrate that a failed fixture has an attributable error span and exception category. Which decision addresses the issue with the fewest unrelated changes?
Explanation
Correct Answer
Only-success telemetry cannot explain intermittent tool failures. On retest, a failed fixture has an attributable error span and exception category.
Incorrect Answers
Agent success assessment should expose the real external tool response.
Failure triage requires more than an HTTP status code.
Version provenance is required to map runtime behavior to configuration changes.