Exam Bundle

A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain. This is evidence for a different corrective change: Set data-minimizing storage and deletion policies across prompt, retrieval, logging, and model telemetry systems. That other change addresses: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. It does not validate the specific Beacon Health Network remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

A controlled attack suite exposes fewer unsafe high-confidence predictions without unacceptable legitimate error. This is evidence for a different corrective change: Evaluate threat-relevant adversarial and out-of-distribution inputs and deploy risk-based input checks or fallback handling. That other change addresses: A public model endpoint is susceptible to adversarial image perturbations but its safety review tests only pristine images. It does not validate the specific Beacon Health Network remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

A harmless summary succeeds but a disallowed export tool call is rejected and logged. This is evidence for a different corrective change: Constrain each agent tool with separate scoped authorization and explicit approval for sensitive actions. That other change addresses: An autonomous workflow agent can invoke billing exports using the same highly privileged identity it uses for ordinary summarization. It does not validate the specific Beacon Health Network remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. This action could be suitable for a different engineering incident: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not directly correct the reported Brookfield Credit Union failure: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The discriminating acceptance check here is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

Evaluate threat-relevant adversarial and out-of-distribution inputs and deploy risk-based input checks or fallback handling. This action could be suitable for a different engineering incident: A public model endpoint is susceptible to adversarial image perturbations but its safety review tests only pristine images. It does not directly correct the reported Brookfield Credit Union failure: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The discriminating acceptance check here is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

Set data-minimizing storage and deletion policies across prompt, retrieval, logging, and model telemetry systems. This action could be suitable for a different engineering incident: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. It does not directly correct the reported Brookfield Credit Union failure: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The discriminating acceptance check here is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain. This is evidence for a different corrective change: Set data-minimizing storage and deletion policies across prompt, retrieval, logging, and model telemetry systems. That other change addresses: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. It does not validate the specific Brookfield Credit Union remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

A forged policy document is rejected or quarantined and the agent cites only authorized versioned sources. This is evidence for a different corrective change: Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. That other change addresses: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not validate the specific Brookfield Credit Union remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

A controlled attack suite exposes fewer unsafe high-confidence predictions without unacceptable legitimate error. This is evidence for a different corrective change: Evaluate threat-relevant adversarial and out-of-distribution inputs and deploy risk-based input checks or fallback handling. That other change addresses: A public model endpoint is susceptible to adversarial image perturbations but its safety review tests only pristine images. It does not validate the specific Brookfield Credit Union remediation for: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. The necessary check instead is: A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest.

Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. This action could be suitable for a different engineering incident: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not directly correct the reported Westhaven Marketplace failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Use Secret Manager or a secured secret-injection workflow and revoke exposed credentials. This action could be suitable for a different engineering incident: A pipeline embeds production database passwords in plain text inside model-training container environment files committed to source control. It does not directly correct the reported Westhaven Marketplace failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Integrate appropriate Model Armor or supported safety and prompt-risk checks alongside least-privilege tool boundaries. This action could be suitable for a different engineering incident: An enterprise agent passes unsanitized untrusted user prompts to sensitive tools with no central policy enforcement. It does not directly correct the reported Westhaven Marketplace failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

A repository scan finds no active plaintext secret and the authorized training task obtains it only at execution time. This is evidence for a different corrective change: Use Secret Manager or a secured secret-injection workflow and revoke exposed credentials. That other change addresses: A pipeline embeds production database passwords in plain text inside model-training container environment files committed to source control. It does not validate the specific Westhaven Marketplace remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Adversarial requests are blocked or constrained before protected tool invocation, with auditable policy decisions. This is evidence for a different corrective change: Integrate appropriate Model Armor or supported safety and prompt-risk checks alongside least-privilege tool boundaries. That other change addresses: An enterprise agent passes unsanitized untrusted user prompts to sensitive tools with no central policy enforcement. It does not validate the specific Westhaven Marketplace remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Held-out subgroup results meet the stated fairness guardrails without hiding deterioration in overall utility. This is evidence for a different corrective change: Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. That other change addresses: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not validate the specific Westhaven Marketplace remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Document feature attributions as model-behavior explanations and require separate causal evidence for intervention claims. This action could be suitable for a different engineering incident: A business team presents feature attribution values from an opaque model as mathematical proof that changing the top-ranked attribute will change an outcome. It does not directly correct the reported Sunset Commerce failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. This action could be suitable for a different engineering incident: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not directly correct the reported Sunset Commerce failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Constrain each agent tool with separate scoped authorization and explicit approval for sensitive actions. This action could be suitable for a different engineering incident: An autonomous workflow agent can invoke billing exports using the same highly privileged identity it uses for ordinary summarization. It does not directly correct the reported Sunset Commerce failure: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The discriminating acceptance check here is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

A harmless summary succeeds but a disallowed export tool call is rejected and logged. This is evidence for a different corrective change: Constrain each agent tool with separate scoped authorization and explicit approval for sensitive actions. That other change addresses: An autonomous workflow agent can invoke billing exports using the same highly privileged identity it uses for ordinary summarization. It does not validate the specific Sunset Commerce remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

The model card labels explanatory associations accurately and rejects unsupported causal conclusions. This is evidence for a different corrective change: Document feature attributions as model-behavior explanations and require separate causal evidence for intervention claims. That other change addresses: A business team presents feature attribution values from an opaque model as mathematical proof that changing the top-ranked attribute will change an outcome. It does not validate the specific Sunset Commerce remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Held-out subgroup results meet the stated fairness guardrails without hiding deterioration in overall utility. This is evidence for a different corrective change: Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. That other change addresses: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not validate the specific Sunset Commerce remediation for: A legal-assistance assistant stores personal prompts indefinitely although contractual retention limits require rapid deletion. The necessary check instead is: A retention test confirms expired personal prompts are deleted while required non-sensitive audit markers remain.

Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. This action could be suitable for a different engineering incident: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not directly correct the reported Horizon Grocery failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Integrate appropriate Model Armor or supported safety and prompt-risk checks alongside least-privilege tool boundaries. This action could be suitable for a different engineering incident: An enterprise agent passes unsanitized untrusted user prompts to sensitive tools with no central policy enforcement. It does not directly correct the reported Horizon Grocery failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Pin reviewed container images and dependencies, verify provenance signatures or digests, and scan for known risks. This action could be suitable for a different engineering incident: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. It does not directly correct the reported Horizon Grocery failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

A forged policy document is rejected or quarantined and the agent cites only authorized versioned sources. This is evidence for a different corrective change: Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. That other change addresses: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not validate the specific Horizon Grocery remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Adversarial requests are blocked or constrained before protected tool invocation, with auditable policy decisions. This is evidence for a different corrective change: Integrate appropriate Model Armor or supported safety and prompt-risk checks alongside least-privilege tool boundaries. That other change addresses: An enterprise agent passes unsanitized untrusted user prompts to sensitive tools with no central policy enforcement. It does not validate the specific Horizon Grocery remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

A tampered artifact is refused at release and the accepted image matches the approved supply-chain manifest. This is evidence for a different corrective change: Pin reviewed container images and dependencies, verify provenance signatures or digests, and scan for known risks. That other change addresses: A team deploys a model package from an unsigned third-party image with dependencies downloaded at runtime from uncontrolled mirrors. It does not validate the specific Horizon Grocery remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. This action could be suitable for a different engineering incident: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not directly correct the reported Silverline Insurance failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. This action could be suitable for a different engineering incident: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not directly correct the reported Silverline Insurance failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Enforce least-privilege artifact permissions, immutable versioning, and integrity checks before model deployment. This action could be suitable for a different engineering incident: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. It does not directly correct the reported Silverline Insurance failure: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The discriminating acceptance check here is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

A developer outside the release role cannot replace the artifact, while the expected digest loads successfully. This is evidence for a different corrective change: Enforce least-privilege artifact permissions, immutable versioning, and integrity checks before model deployment. That other change addresses: A trained model is saved in a broadly writable bucket where unrelated developers can replace weights without authorization. It does not validate the specific Silverline Insurance remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

A forged policy document is rejected or quarantined and the agent cites only authorized versioned sources. This is evidence for a different corrective change: Validate trusted document provenance, restrict source updates, and record retrieval lineage before ingesting new context. That other change addresses: A question-answering agent indexes mutable policy documents without content verification, allowing poisoned text to contaminate answers. It does not validate the specific Silverline Insurance remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.

Held-out subgroup results meet the stated fairness guardrails without hiding deterioration in overall utility. This is evidence for a different corrective change: Measure group-sliced error and fairness metrics, investigate feature bias, and enforce an approved remediation process. That other change addresses: A hiring predictor has good total accuracy but systematically rejects qualified applicants from one audited group. It does not validate the specific Silverline Insurance remediation for: A decision model provides probability scores but the governance report offers no reproducible local explanation for an adverse case. The necessary check instead is: An authorized reviewer reproduces a local feature contribution for a frozen case without treating it as causal proof.