Question 60
During a security incident tabletop exercise at Lakeview Insurance, engineers say that they resolved this finding: A vector-search assistant returns confidential documents from another tenant because embedding matches ignore access labels. Which result provides the STRONGEST acceptance evidence?
Explanation
Correct Answer
The same search returns only permitted documents for each tested tenant. This is the decisive evidence for the original problem: A vector-search assistant returns confidential documents from another tenant because embedding matches ignore access labels. It verifies that the intended corrective control—Filter search candidates by authenticated tenant and document entitlements before returning context—works in the relevant environment; a completed change ticket alone would not prove the outcome at Lakeview Insurance.
Incorrect Answers
Adversarial requests do not disclose secrets and legitimate support tasks still work. This would be relevant evidence for a different failure: A prompt sent to a support chatbot induces it to display internal system instructions and hidden credentials, usually addressed by Remove secrets from prompt context and enforce privileged instruction boundaries and output testing. It does not demonstrate that the current problem at Lakeview Insurance was resolved. The specific required evidence is: The same search returns only permitted documents for each tested tenant.
Poisoned or superseded records are excluded and answers link to the authorized version. This would be relevant evidence for a different failure: An assistant repeats a poisoned document's false policy because its retrieval index lacks source integrity metadata, usually addressed by Validate source provenance, signed approvals, and current revision before incorporating retrieved text. It does not demonstrate that the current problem at Lakeview Insurance was resolved. The specific required evidence is: The same search returns only permitted documents for each tested tenant.
The connector executes only after provenance and dependency checks pass. This would be relevant evidence for a different failure: A model agent installs a third-party model connector from an unreviewed source with unknown dependencies, usually addressed by Require signed or verified dependencies, supply-chain scanning, and restricted runtime permissions. It does not demonstrate that the current problem at Lakeview Insurance was resolved. The specific required evidence is: The same search returns only permitted documents for each tested tenant.