Question 650
The reliability team at Mercury Travel Tech is closing a corrective-action ticket for this ML failure: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
A complete run records stage dependencies, retries, and lineage without an operator manually invoking each stage. This controlled observation specifically validates the proposed remedy: Use Gemini Enterprise Agent Platform Pipelines with versioned, parameterized stages for the supported workflow. It addresses the documented failure at Mercury Travel Tech: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components.
Incorrect Answers
A passing but unapproved model remains nonproduction; approved promotion records the reviewer and artifact hash. This is evidence for a different corrective change: Add a controlled manual approval step after automated evidence collection and before production promotion. That other change addresses: A sensitive-risk model is automatically deployed after evaluation even though an accountable human sign-off is required. It does not validate the specific Mercury Travel Tech remediation for: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components. The necessary check instead is: A complete run records stage dependencies, retries, and lineage without an operator manually invoking each stage.
An unsafe candidate fails the release pipeline even if its standard instruction score is high. This is evidence for a different corrective change: Add a safety and privacy evaluation gate with reviewed adversarial and refusal cases to the training pipeline. That other change addresses: An LLM evaluation pipeline optimizes instruction following but never measures safe refusals on sensitive customer requests. It does not validate the specific Mercury Travel Tech remediation for: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components. The necessary check instead is: A complete run records stage dependencies, retries, and lineage without an operator manually invoking each stage.
The registry version resolves to the final pipeline output hash and associated metrics. This is evidence for a different corrective change: Register the output artifact with its immutable digest, approved evaluation, and source pipeline run. That other change addresses: A successful pipeline writes a model to an arbitrary folder without immutable version information, leaving registry entries out of sync. It does not validate the specific Mercury Travel Tech remediation for: A straightforward model workflow is built from a fragile hand-managed shell scheduler even though it needs repeatable managed pipeline components. The necessary check instead is: A complete run records stage dependencies, retries, and lineage without an operator manually invoking each stage.