Question 670
Following a proposed change in a decision-support initiative at Tamarack Housing, the procurement program reports that it addressed the following need under an upcoming readiness review: An AI service continues operating after anomalous automated tool calls with no incident procedure. Which observation provides the STRONGEST evidence that the change worked?
Explanation
Correct Answer
An incident simulation demonstrates the team can disable risky tools and restore safely. This is the direct observable test of the intended response: Define detection, containment, escalation, and recovery processes for AI-specific incidents. In the context of Tamarack Housing's a decision-support initiative, it checks an actual outcome instead of treating completion of a project ticket or an untested assertion as evidence.
Incorrect Answers
Log sampling shows required telemetry without unnecessary sensitive values. This would instead validate the different situation: A service logs complete user prompts containing confidential data for indefinite retention. It would ordinarily follow the action: Minimize sensitive logging, restrict log access, and apply defined retention periods. It does not establish that Tamarack Housing solved the need specified in this scenario; the relevant check is: An incident simulation demonstrates the team can disable risky tools and restore safely.
Prompt-injection trials cannot exfiltrate restricted records through allowed tools. This would instead validate the different situation: An agent copies secret customer records into an external URL supplied by a retrieved document. It would ordinarily follow the action: Treat retrieved text as untrusted, limit tools and egress, and require authorization for data transfer. It does not establish that Tamarack Housing solved the need specified in this scenario; the relevant check is: An incident simulation demonstrates the team can disable risky tools and restore safely.
Unauthorized edits and cross-team reads fail in role-based access tests. This would instead validate the different situation: A retrieval agent has administrator access to source repositories even though users need read-only excerpts. It would ordinarily follow the action: Enforce IAM least privilege and identity-aware authorization for service accounts and retrieval tools. It does not establish that Tamarack Housing solved the need specified in this scenario; the relevant check is: An incident simulation demonstrates the team can disable risky tools and restore safely.