Question 810
The reliability team at Mercury Travel Tech is closing a corrective-action ticket for this ML failure: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
A developer outside the release role cannot replace the artifact, while the expected digest loads successfully. This controlled observation specifically validates the proposed remedy: Enforce least-privilege artifact permissions, immutable versioning, and integrity checks before model deployment. It addresses the documented failure at Mercury Travel Tech: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization.
Incorrect Answers
A controlled attack suite exposes fewer unsafe high-confidence predictions without unacceptable legitimate error. This is evidence for a different corrective change: Evaluate threat-relevant adversarial and out-of-distribution inputs and deploy risk-based input checks or fallback handling. That other change addresses: A public model endpoint is susceptible to adversarial image perturbations but its safety review tests only pristine images. It does not validate the specific Mercury Travel Tech remediation for: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. The necessary check instead is: A developer outside the release role cannot replace the artifact, while the expected digest loads successfully.
Authorized feature reads succeed and cross-team dataset access attempts are denied in the audit trail. This is evidence for a different corrective change: Restrict inference service access to its exact datasets and serving resources using narrowly scoped identities. That other change addresses: A production inference identity can list all organization datasets although it only requires one approved feature view. It does not validate the specific Mercury Travel Tech remediation for: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. The necessary check instead is: A developer outside the release role cannot replace the artifact, while the expected digest loads successfully.
A harmless summary succeeds but a disallowed export tool call is rejected and logged. This is evidence for a different corrective change: Constrain each agent tool with separate scoped authorization and explicit approval for sensitive actions. That other change addresses: An autonomous workflow agent can invoke billing exports using the same highly privileged identity it uses for ordinary summarization. It does not validate the specific Mercury Travel Tech remediation for: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. The necessary check instead is: A developer outside the release role cannot replace the artifact, while the expected digest loads successfully.