Question 160
For Silverline Insurance, the engineer must verify a remediation with measured evidence, not just a deployment claim. The original failure was: A serving team scales revenue by thousands while training used unscaled currency, creating train-serving skew. What measured outcome provides the strongest check that this problem is resolved?
Explanation
Correct Answer
Matching test inputs generate the same feature vectors offline and online within documented numeric tolerance. This controlled observation specifically validates the proposed remedy: Persist the preprocessing artifact and reuse the same transform in training and inference paths. It addresses the documented failure at Silverline Insurance: A serving team scales revenue by thousands while training used unscaled currency, creating train-serving skew.
Incorrect Answers
The full-scale integration finishes without notebook OOM and matches checksums on a validated sample. This is evidence for a different corrective change: Use a suitable distributed preprocessing engine such as Spark on Dataproc for the large shuffle and persist curated outputs. That other change addresses: A data science team attempts to join terabytes of distributed logs inside a single notebook's pandas process and repeatedly exhausts memory. It does not validate the specific Silverline Insurance remediation for: A serving team scales revenue by thousands while training used unscaled currency, creating train-serving skew. The necessary check instead is: Matching test inputs generate the same feature vectors offline and online within documented numeric tolerance.
A backward-compatible new optional field passes, while removing a required field fails fast with a clear error. This is evidence for a different corrective change: Adopt compatible schema evolution with explicit validation of required fields and controlled handling of unknown optional properties. That other change addresses: A transaction feed adds optional properties weekly but the downstream feature job breaks whenever the JSON payload has a new field. It does not validate the specific Silverline Insurance remediation for: A serving team scales revenue by thousands while training used unscaled currency, creating train-serving skew. The necessary check instead is: Matching test inputs generate the same feature vectors offline and online within documented numeric tolerance.
A deliberate category-type change triggers the rejection path while schema-valid data reaches the curated table. This is evidence for a different corrective change: Validate type, required fields, and allowed categories at ingestion and quarantine incompatible batches. That other change addresses: A product classification ingestion job silently coerces the string category column into null after upstream schema changes. It does not validate the specific Silverline Insurance remediation for: A serving team scales revenue by thousands while training used unscaled currency, creating train-serving skew. The necessary check instead is: Matching test inputs generate the same feature vectors offline and online within documented numeric tolerance.