Question 630
An audit of the proposed fix for Beacon Health Network requires a specific controlled check. The issue under review is: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
A synthetic renamed field is quarantined and the registered training schema stays intact. This controlled observation specifically validates the proposed remedy: Apply versioned schema checks and fail fast on incompatible field changes before feature materialization. It addresses the documented failure at Beacon Health Network: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features.
Incorrect Answers
An injected high-null batch fails the pipeline at validation and creates an actionable report before training starts. This is evidence for a different corrective change: Implement explicit data quality gates for critical null rates and block downstream training or deployment on failure. That other change addresses: An automated ML pipeline accepts a new training table with 80 percent missing values and still deploys a resulting model without notifying anyone. It does not validate the specific Beacon Health Network remediation for: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features. The necessary check instead is: A synthetic renamed field is quarantined and the registered training schema stays intact.
An auditor can traverse from a serving model version to input dataset and execution IDs without missing links. This is evidence for a different corrective change: Collect pipeline metadata and model lineage linking data artifacts, transformed features, code, and model versions. That other change addresses: A deployed model cannot be traced back to the source transformations because pipeline output records omit component-level metadata. It does not validate the specific Beacon Health Network remediation for: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features. The necessary check instead is: A synthetic renamed field is quarantined and the registered training schema stays intact.
The registry version resolves to the final pipeline output hash and associated metrics. This is evidence for a different corrective change: Register the output artifact with its immutable digest, approved evaluation, and source pipeline run. That other change addresses: A successful pipeline writes a model to an arbitrary folder without immutable version information, leaving registry entries out of sync. It does not validate the specific Beacon Health Network remediation for: A data provider renames a key field and the pipeline substitutes empty strings, silently changing all model input features. The necessary check instead is: A synthetic renamed field is quarantined and the registered training schema stays intact.