Question 680
Following a proposed change in a cross-team productivity initiative at Yellowstone Software, the regional operations team reports that it addressed the following need under restricted source access: Customers cannot tell whether a chatbot is automated or how to request a human agent. Which observation provides the STRONGEST evidence that the change worked?
Explanation
Correct Answer
Test users can identify automation and successfully reach a human when needed. This is the direct observable test of the intended response: Provide clear AI-use disclosures, capability limits, and accessible escalation. In the context of Yellowstone Software's a cross-team productivity initiative, it checks an actual outcome instead of treating completion of a project ticket or an untested assertion as evidence.
Incorrect Answers
Independent monitoring reports group-level metrics and the disposition of observed disparities. This would instead validate the different situation: An employee-screening assistant has unequal error rates across relevant groups. It would ordinarily follow the action: Conduct fairness evaluations on representative slices and correct unjustified disparities before use. It does not establish that Yellowstone Software solved the need specified in this scenario; the relevant check is: Test users can identify automation and successfully reach a human when needed.
Privacy testing confirms unnecessary direct identifiers are absent from the workflow. This would instead validate the different situation: A marketing assistant ingests customer contact details that are not needed to generate a generic campaign. It would ordinarily follow the action: Use data minimization and appropriate anonymization or pseudonymization before model processing. It does not establish that Yellowstone Software solved the need specified in this scenario; the relevant check is: Test users can identify automation and successfully reach a human when needed.
A privacy assessment documents approved purposes, retention, and any required consents. This would instead validate the different situation: A pilot uses internal employee communications without checking collection purpose or permitted use. It would ordinarily follow the action: Verify lawful basis, consent where applicable, notices, and access permissions for intended data use. It does not establish that Yellowstone Software solved the need specified in this scenario; the relevant check is: Test users can identify automation and successfully reach a human when needed.