Question 150
Following a proposed change in a decision-support initiative at Eastshore Hospitality, the quality assurance team reports that it addressed the following need under an upcoming readiness review: A department assumes an LLM automatically has an authenticated connection to an HR database. Which observation provides the STRONGEST evidence that the change worked?
Explanation
Correct Answer
The assistant retrieves an allowed HR record only through logged, permission-checked access. This is the direct observable test of the intended response: Add an authorized tool or retrieval integration rather than relying on model weights to access records. In the context of Eastshore Hospitality's a decision-support initiative, it checks an actual outcome instead of treating completion of a project ticket or an untested assertion as evidence.
Incorrect Answers
A controlled test shows tool invocations and reviewable outcomes for a permitted order request. This would instead validate the different situation: An order-processing assistant must call approved external systems rather than just write text. It would ordinarily follow the action: Model the agent layer as coordinating steps and authorized tools under explicit constraints. It does not establish that Eastshore Hospitality solved the need specified in this scenario; the relevant check is: The assistant retrieves an allowed HR record only through logged, permission-checked access.
A safe demo shows the agent coordinating allowed actions while the static app performs text-only output. This would instead validate the different situation: An executive expects an autonomous agent to be identical to a static question-answer application. It would ordinarily follow the action: Differentiate tool-using task orchestration from an application that only displays generated text. It does not establish that Eastshore Hospitality solved the need specified in this scenario; the relevant check is: The assistant retrieves an allowed HR record only through logged, permission-checked access.
Capacity measurements tie workload throughput to the selected infrastructure configuration. This would instead validate the different situation: An executive blames the application interface for training workloads limited by accelerator capacity. It would ordinarily follow the action: Identify compute infrastructure such as TPUs, GPUs, and networking as the layer responsible for heavy computation. It does not establish that Eastshore Hospitality solved the need specified in this scenario; the relevant check is: The assistant retrieves an allowed HR record only through logged, permission-checked access.