Question 70
At Aspen Digital, a team reports that it corrected the following problem affecting advisory applications and shared files: A language-model plugin can invoke arbitrary shell commands although the approved purpose is simple file summarization. Which observation BEST verifies that the correction actually worked?
Explanation
Correct Answer
Attempted command execution is denied while authorized summaries remain functional. This is the decisive evidence for the original problem: A language-model plugin can invoke arbitrary shell commands although the approved purpose is simple file summarization. It verifies that the intended corrective control—Remove general execution privileges and expose only a narrow read-only interface with audited scope—works in the relevant environment; a completed change ticket alone would not prove the outcome at Aspen Digital.
Incorrect Answers
The same search returns only permitted documents for each tested tenant. This would be relevant evidence for a different failure: A vector-search assistant returns confidential documents from another tenant because embedding matches ignore access labels, usually addressed by Filter search candidates by authenticated tenant and document entitlements before returning context. It does not demonstrate that the current problem at Aspen Digital was resolved. The specific required evidence is: Attempted command execution is denied while authorized summaries remain functional.
The connector executes only after provenance and dependency checks pass. This would be relevant evidence for a different failure: A model agent installs a third-party model connector from an unreviewed source with unknown dependencies, usually addressed by Require signed or verified dependencies, supply-chain scanning, and restricted runtime permissions. It does not demonstrate that the current problem at Aspen Digital was resolved. The specific required evidence is: Attempted command execution is denied while authorized summaries remain functional.
Poisoned or superseded records are excluded and answers link to the authorized version. This would be relevant evidence for a different failure: An assistant repeats a poisoned document's false policy because its retrieval index lacks source integrity metadata, usually addressed by Validate source provenance, signed approvals, and current revision before incorporating retrieved text. It does not demonstrate that the current problem at Aspen Digital was resolved. The specific required evidence is: Attempted command execution is denied while authorized summaries remain functional.