Question 490
At the Dunbridge property management business, a product categorizer's accuracy declines after the company introduces a new catalog taxonomy. Which explanation best accounts for the concern?
Explanation
Correct Answer
The problem stems from the fact that changes in data distributions can invalidate previously adequate performance. A correct solution would monitor outcome metrics for drift and refresh the model or rules through a controlled process and check that a monitored category-accuracy metric flags the seeded taxonomy shift. This result addresses the stated challenge at the Dunbridge property management business.
Incorrect Answers
The case does not describe the failure mode involving evaluation kpi mismatch. Its core issue is that changes in data distributions can invalidate previously adequate performance. For the Dunbridge property management business, the direct corrective action is to monitor outcome metrics for drift and refresh the model or rules through a controlled process.
This explanation addresses a separate generative AI business leadership problem. In this case, the observable gap is that changes in data distributions can invalidate previously adequate performance. For the Dunbridge property management business, the direct corrective action is to monitor outcome metrics for drift and refresh the model or rules through a controlled process.
Simple tasks may not require example-heavy prompts that increase context and cost. That may occur elsewhere, but the evidence at the Dunbridge property management business instead points to the fact that changes in data distributions can invalidate previously adequate performance.