Question 310
A model team assumes unlabeled production data is enough to compute true precision in real time. The proposed fix needs to work without changing unrelated approved resources. The sign-off condition is that the dashboard distinguishes unlabeled prediction shift from labeled precision measurements. What should the release engineer do before proceeding?
Explanation
Correct Answer
Precision requires true outcome labels, while prediction drift can use outputs alone. After the change, the dashboard distinguishes unlabeled prediction shift from labeled precision measurements.
Incorrect Answers
Prediction drift detects changes in model output distributions rather than only inputs.
Prediction drift requires actual inference outputs, not just endpoint status.
A moving reference changes the meaning of the reported drift distance.