Question 100
Following a proposed change in a decision-support initiative at Oakridge Retail, the commercial systems team reports that it addressed the following need under restricted source access: A pricing assistant references an obsolete discount table after the commercial team changes the policy. Which observation provides the STRONGEST evidence that the change worked?
Explanation
Correct Answer
After a scheduled update the assistant retrieves the newly approved prices and expiry rules. This is the direct observable test of the intended response: Set freshness ownership and an update schedule for authoritative pricing data. In the context of Oakridge Retail's a decision-support initiative, it checks an actual outcome instead of treating completion of a project ticket or an untested assertion as evidence.
Incorrect Answers
Retrieval evaluations show more task-relevant references rather than just a larger index. This would instead validate the different situation: A team adds thousands of old off-topic pages hoping raw corpus size will improve answers. It would ordinarily follow the action: Filter and curate source material for relevance to the approved use cases. It does not establish that Oakridge Retail solved the need specified in this scenario; the relevant check is: After a scheduled update the assistant retrieves the newly approved prices and expiry rules.
Tests across user roles show restricted documents are never returned to unauthorized users. This would instead validate the different situation: A project plans to make every enterprise document visible to a search assistant regardless of entitlement. It would ordinarily follow the action: Preserve identity-based access controls and data ownership when making sources accessible to AI. It does not establish that Oakridge Retail solved the need specified in this scenario; the relevant check is: After a scheduled update the assistant retrieves the newly approved prices and expiry rules.
The dataset inventory flags actual target labels rather than merely descriptive input features. This would instead validate the different situation: An analyst confuses labeled outcome examples with unlabeled transaction logs. It would ordinarily follow the action: Identify which examples contain verified target labels before choosing a supervised approach. It does not establish that Oakridge Retail solved the need specified in this scenario; the relevant check is: After a scheduled update the assistant retrieves the newly approved prices and expiry rules.