Question 690
For Brookfield Credit Union, the engineer must verify a remediation with measured evidence, not just a deployment claim. The original failure was: An online fraud model receives raw categories but the training DAG applied a different tokenizer hidden inside a notebook. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
Identical raw fixtures produce matching transformed features in both paths and automated parity tests pass. This controlled observation specifically validates the proposed remedy: Package the preprocessing transform as a reusable versioned component shared between offline training and serving. It addresses the documented failure at Brookfield Credit Union: An online fraud model receives raw categories but the training DAG applied a different tokenizer hidden inside a notebook.
Incorrect Answers
A passing but unapproved model remains nonproduction; approved promotion records the reviewer and artifact hash. This is evidence for a different corrective change: Add a controlled manual approval step after automated evidence collection and before production promotion. That other change addresses: A sensitive-risk model is automatically deployed after evaluation even though an accountable human sign-off is required. It does not validate the specific Brookfield Credit Union remediation for: An online fraud model receives raw categories but the training DAG applied a different tokenizer hidden inside a notebook. The necessary check instead is: Identical raw fixtures produce matching transformed features in both paths and automated parity tests pass.
A simulated late failure resumes from a completed checkpoint without repeating successful expensive stages. This is evidence for a different corrective change: Persist validated intermediate artifacts and allow safe resume from completed pipeline stages. That other change addresses: A long multi-stage training job loses all intermediate work when a downstream stage fails just before deployment. It does not validate the specific Brookfield Credit Union remediation for: An online fraud model receives raw categories but the training DAG applied a different tokenizer hidden inside a notebook. The necessary check instead is: Identical raw fixtures produce matching transformed features in both paths and automated parity tests pass.
A synthetic renamed field is quarantined and the registered training schema stays intact. This is evidence for a different corrective change: Apply versioned schema checks and fail fast on incompatible field changes before feature materialization. That other change addresses: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features. It does not validate the specific Brookfield Credit Union remediation for: An online fraud model receives raw categories but the training DAG applied a different tokenizer hidden inside a notebook. The necessary check instead is: Identical raw fixtures produce matching transformed features in both paths and automated parity tests pass.