Question 40
The reliability team at Stonewell Payments is closing a corrective-action ticket for this ML failure: A finance analyst has a trained BigQuery ML model but exports raw coefficients to a spreadsheet and manually reimplements inference with a mismatched schema. What measured outcome provides the strongest check that this problem is resolved?
Explanation
Correct Answer
Prediction output rows and model metadata match the SQL inference schema on a controlled sample without spreadsheet recoding. This controlled observation specifically validates the proposed remedy: Run BigQuery ML prediction against the governed input table with ML.PREDICT and the recorded feature mapping. It addresses the documented failure at Stonewell Payments: A finance analyst has a trained BigQuery ML model but exports raw coefficients to a spreadsheet and manually reimplements inference with a mismatched schema.
Incorrect Answers
The frozen test set shows improved high-risk recall at an explicitly acceptable false-positive review volume. This is evidence for a different corrective change: Evaluate classification candidates using recall, precision-recall tradeoffs, and a decision threshold tied to default-review cost. That other change addresses: A loan dataset contains a rare default class, but a BigQuery ML model is selected using overall accuracy alone despite high false negatives. It does not validate the specific Stonewell Payments remediation for: A finance analyst has a trained BigQuery ML model but exports raw coefficients to a spreadsheet and manually reimplements inference with a mismatched schema. The necessary check instead is: Prediction output rows and model metadata match the SQL inference schema on a controlled sample without spreadsheet recoding.
A deliberately renamed required feature fails the preflight while a matching schema yields non-null results. This is evidence for a different corrective change: Validate prediction input column names and types against the registered BigQuery ML model signature before scoring. That other change addresses: A fraud team passes a renamed transaction field to ML.PREDICT and silently accepts null predictions from an incompatible scoring schema. It does not validate the specific Stonewell Payments remediation for: A finance analyst has a trained BigQuery ML model but exports raw coefficients to a spreadsheet and manually reimplements inference with a mismatched schema. The necessary check instead is: Prediction output rows and model metadata match the SQL inference schema on a controlled sample without spreadsheet recoding.
A controlled dataset with nulls produces complete training rows and a per-column missingness audit without label leakage. This is evidence for a different corrective change: Define and fit an explicit BigQuery ML missing-value imputation strategy and track the percentage of imputed records. That other change addresses: A product-cost prediction query silently drops rows with missing numeric features, biasing the downstream training sample. It does not validate the specific Stonewell Payments remediation for: A finance analyst has a trained BigQuery ML model but exports raw coefficients to a spreadsheet and manually reimplements inference with a mismatched schema. The necessary check instead is: Prediction output rows and model metadata match the SQL inference schema on a controlled sample without spreadsheet recoding.