Question 860
At Westmoor Sports, a consumer membership desk is improving membership renewals before expanding the internal rollout (SF-P16-01). The administrator observes that a field generation prompt produces variable-length paragraphs where downstream users require a brief summary. Any fix must ensure that member records cannot be exposed to other members. Which observable result would best demonstrate that the correction actually worked?
Explanation
Correct Answer
This is the direct acceptance signal for the reported failure: In a controlled Contact acceptance test, sample outputs follow the stated length and format across different case records; the record is retained under Westmoor Sports's rollout (SF-P16-01). The chosen correction was to state the task, approved sources, output length, and expected format in explicit prompt instructions; the measurement therefore tests the relevant source, routing or authorization outcome rather than unrelated activity.
Incorrect Answers
The proposed observation “A null-field case produces the approved fallback rather than a fabricated date; confirm this using a representative sandbox fixture” would check a different original case: A template tells the model to use only current CRM values but also to invent friendly dates for empty fields. The correction must ensure that donor details cannot be revealed across accounts. Its mechanism is: Conflicting directions undermine deterministic expectations and reliable evaluation. In the present case, a field generation prompt produces variable-length paragraphs where downstream users require a brief summary. The correction must ensure that member records cannot be exposed to other members; the more direct acceptance evidence is “Sample outputs follow the stated length and format across different case records; confirm this and confirm the resulting trace” because clear role, context, constraints, and output format improve prompt consistency.
The proposed observation “A missing-date test returns a factual limitation rather than an invented delivery promise; confirm this with production-equivalent source conditions” would check a different original case: A generative service reply fills missing delivery dates with invented estimates. The correction must ensure that financial identifiers are masked outside authorized roles. Its mechanism is: Prompts need explicit abstention behavior when grounding does not supply an answer. In the present case, a field generation prompt produces variable-length paragraphs where downstream users require a brief summary. The correction must ensure that member records cannot be exposed to other members; the more direct acceptance evidence is “Sample outputs follow the stated length and format across different case records; confirm this and confirm the resulting trace” because clear role, context, constraints, and output format improve prompt consistency.
The proposed observation “A dated acceptance case reproduces current contract facts from the permitted record; confirm this with production-equivalent source conditions” would check a different original case: Generated customer responses cite outdated contract terms even though current CRM records are available. The correction must ensure that part inventory decisions use approved current records. Its mechanism is: Grounding supplies external factual context to generation and reduces unsupported guessing. In the present case, a field generation prompt produces variable-length paragraphs where downstream users require a brief summary. The correction must ensure that member records cannot be exposed to other members; the more direct acceptance evidence is “Sample outputs follow the stated length and format across different case records; confirm this and confirm the resulting trace” because clear role, context, constraints, and output format improve prompt consistency.