Question 80
At Keystone Telecom, a technical contact center is improving network fault support during a controlled sandbox pilot (SF-G05-03). The administrator observes that agent resolution scores fall when a new knowledge source is connected. Any fix must ensure that production changes remain gated by approval. Which observable result would best demonstrate that the correction actually worked?
Explanation
Correct Answer
This is the direct acceptance signal for the reported failure: In a controlled Incident__c acceptance test, the test cohort shows improved relevance without exposing unrelated knowledge; the record is retained under Keystone Telecom's rollout (SF-G05-03). The chosen correction was to compare retrieval quality evidence and sampled grounded answers before changing instructions; the measurement therefore tests the relevant source, routing or authorization outcome rather than unrelated activity.
Incorrect Answers
The proposed observation “Reviewers can identify the retrieved context and branch that shaped the incorrect estimate; confirm this using a representative sandbox fixture” would check a different original case: A user reports an inaccurate refund estimate and the team cannot see which facts the agent used. The correction must ensure that production changes remain gated by approval. Its mechanism is: Interaction traces connect reported output problems to actual execution evidence. In the present case, agent resolution scores fall when a new knowledge source is connected. The correction must ensure that production changes remain gated by approval; the more direct acceptance evidence is “The test cohort shows improved relevance without exposing unrelated knowledge; confirm this using a least-privilege test identity” because agent quality changes can arise from retrieval behavior as well as prompt text.
The proposed observation “The diagnostic view identifies the specific action failure rate and error context; confirm this while testing the unauthorized case” would check a different original case: One custom action intermittently fails but average conversation ratings remain high. The correction must ensure that service changes follow approved warranty conditions. Its mechanism is: Action telemetry supports targeted repair that broad satisfaction scores cannot. In the present case, agent resolution scores fall when a new knowledge source is connected. The correction must ensure that production changes remain gated by approval; the more direct acceptance evidence is “The test cohort shows improved relevance without exposing unrelated knowledge; confirm this using a least-privilege test identity” because agent quality changes can arise from retrieval behavior as well as prompt text.
The proposed observation “Monitoring detects rising policy-violation patterns despite stable response latency; confirm this using a least-privilege test identity” would check a different original case: An agent sometimes emits policy-inconsistent responses but only uptime is monitored. The correction must ensure that employee case files are accessible only to the case owner. Its mechanism is: Agent health includes trust and quality measures as well as uptime. In the present case, agent resolution scores fall when a new knowledge source is connected. The correction must ensure that production changes remain gated by approval; the more direct acceptance evidence is “The test cohort shows improved relevance without exposing unrelated knowledge; confirm this using a least-privilege test identity” because agent quality changes can arise from retrieval behavior as well as prompt text.