Question 30
The acceptance reviewer at Beacon Health Network needs independent proof of the correction to this reported ML problem: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
A controlled dataset with nulls produces complete training rows and a per-column missingness audit without label leakage. This controlled observation specifically validates the proposed remedy: Define and fit an explicit BigQuery ML missing-value imputation strategy and track the percentage of imputed records. It addresses the documented failure at Beacon Health Network: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample.
Incorrect Answers
Held-out user-item recommendations rank relevant items more effectively than a non-personalized popularity baseline. This is evidence for a different corrective change: Use a BigQuery ML recommendation approach such as matrix factorization with appropriate user, item, and interaction data. That other change addresses: A media platform seeks implicit user-item recommendations but trains an ordinary numeric sales regression with user IDs as magnitudes. It does not validate the specific Beacon Health Network remediation for: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample. The necessary check instead is: A controlled dataset with nulls produces complete training rows and a per-column missingness audit without label leakage.
A time-sliced audit proves no input timestamp occurs after the forecast cutoff and the leakage-driven score inflation disappears. This is evidence for a different corrective change: Remove future-known cancellation fields and rebuild features using only observations available at the prediction cutoff. That other change addresses: A subscription model uses a churn-cancellation timestamp recorded after prediction time as a BigQuery ML input and reports implausible accuracy. It does not validate the specific Beacon Health Network remediation for: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample. The necessary check instead is: A controlled dataset with nulls produces complete training rows and a per-column missingness audit without label leakage.
Cluster assignments and separation diagnostics reveal coherent groups without requiring fabricated customer labels. This is evidence for a different corrective change: Apply BigQuery ML K-means clustering to meaningful standardized unlabeled behavior features and inspect resulting segments. That other change addresses: An operations team wants to segment unlabeled customer behavior yet supplies made-up class labels to a supervised classifier. It does not validate the specific Beacon Health Network remediation for: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample. The necessary check instead is: A controlled dataset with nulls produces complete training rows and a per-column missingness audit without label leakage.