Question 680
The reliability team at Silverline Insurance is closing a corrective-action ticket for this ML failure: The pipeline runner executes as a project administrator and can change unrelated production services even though it only needs designated data and model permissions. What measured outcome provides the strongest check that this problem is resolved?
Explanation
Correct Answer
The intended DAG succeeds while attempts to modify unrelated project services receive permission denial. This controlled observation specifically validates the proposed remedy: Bind pipeline stages to narrow service identities and enforce scoped permissions for each resource. It addresses the documented failure at Silverline Insurance: The pipeline runner executes as a project administrator and can change unrelated production services even though it only needs designated data and model permissions.
Incorrect Answers
A simulated late failure resumes from a completed checkpoint without repeating successful expensive stages. This is evidence for a different corrective change: Persist validated intermediate artifacts and allow safe resume from completed pipeline stages. That other change addresses: A long multi-stage training job loses all intermediate work when a downstream stage fails just before deployment. It does not validate the specific Silverline Insurance remediation for: The pipeline runner executes as a project administrator and can change unrelated production services even though it only needs designated data and model permissions. The necessary check instead is: The intended DAG succeeds while attempts to modify unrelated project services receive permission denial.
Holdout identity and permissions checks confirm test records were excluded from fit and tuning. This is evidence for a different corrective change: Create an isolated versioned evaluation split that the training step cannot read for optimization. That other change addresses: A training pipeline evaluates a model on the same rows used for fitting because the only available dataset path is labeled training. It does not validate the specific Silverline Insurance remediation for: The pipeline runner executes as a project administrator and can change unrelated production services even though it only needs designated data and model permissions. The necessary check instead is: The intended DAG succeeds while attempts to modify unrelated project services receive permission denial.
A complete run records stage dependencies, retries, and lineage without an operator manually invoking each stage. This is evidence for a different corrective change: Use Gemini Enterprise Agent Platform Pipelines with versioned, parameterized stages for the supported workflow. That other change addresses: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components. It does not validate the specific Silverline Insurance remediation for: The pipeline runner executes as a project administrator and can change unrelated production services even though it only needs designated data and model permissions. The necessary check instead is: The intended DAG succeeds while attempts to modify unrelated project services receive permission denial.