Question 660
A small model is selected for fine-tuning to lower inference cost, but the team checks only training loss before deployment. Before rollout, the engineer must confirm that the smaller tuned candidate meets the predefined production accuracy and cost thresholds. Which change most directly addresses the observed behavior?
Explanation
Correct Answer
Lower training loss does not establish an acceptable tradeoff for end-user tasks. A test run should show that the smaller tuned candidate meets the predefined production accuracy and cost thresholds.
Incorrect Answers
Model fine-tuning support depends on exact model, method, service tier and region.
Supervised tuning requires training signals linking representative prompts to desired responses.
Contradictory supervision can teach unstable response behavior even when the job completes; lower training loss does not establish an acceptable tradeoff for end-user tasks.