Question 830
A text classifier is trained on labels assigned by temporary staff with no review of disagreement. The concern is on the agenda for a risk management meeting. What should the responsible team do first to correct the specific weakness?
Explanation
Correct Answer
Audit labeling quality, ambiguity and inter-rater agreement before relying on labels. It addresses the failure that inconsistent labels can encode errors and distort learning targets. The expected evidence is that label audits identify disagreement and show a controlled adjudication process.
Incorrect Answers
That action can help where sampling imbalance threatens generalization and fair treatment. It does not correct the current weakness: inconsistent labels can encode errors and distort learning targets.
That action can help where training and testing omitted foreseeable manipulation and failure modes. It does not correct the current weakness: inconsistent labels can encode errors and distort learning targets.
That action can help where historical data may no longer represent the intended task or current policy. It does not correct the current weakness: inconsistent labels can encode errors and distort learning targets.