Question 220
At Timberline Foods, the ML platform team maintains warehouse forecasting and order-risk models under requirements for accurate real-time features and cost-controlled training. Following the controlled change, the team validates: A time-series demand model shuffles future demand records into an earlier training window, invalidating its forward-looking evaluation. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
The training cutoff precedes the first validation observation and a forward rolling evaluation reproduces the expected boundaries. This is observable proof for correction of: A time-series demand model shuffles future demand records into an earlier training window, invalidating its forward-looking evaluation. The approved design change is: Use chronological training, validation and final holdout windows with a gap where leakage risk requires one. The Timberline Foods acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A multilingual test phrase yields the same token IDs in the training pipeline and deployed inference endpoint. This would verify a different operation: Version a single canonical text normalization and tokenizer artifact and use it in both processing and serving containers. That separate action addresses: A text classifier tokenizes raw Unicode text differently in batch training and the real-time inference application. It cannot establish the required Timberline Foods correction for: A time-series demand model shuffles future demand records into an earlier training window, invalidating its forward-looking evaluation. The decisive acceptance check is instead: The training cutoff precedes the first validation observation and a forward rolling evaluation reproduces the expected boundaries.
Model input checks confirm no implied numerical ordering and all expected regions map to the approved encoded features. This would verify a different operation: Apply an appropriate categorical encoding while preserving the region identifier's nominal semantics and missing-value policy. That separate action addresses: A numeric categorical code such as region ID is mistakenly treated as an ordered magnitude when supplied to a linear model. It cannot establish the required Timberline Foods correction for: A time-series demand model shuffles future demand records into an earlier training window, invalidating its forward-looking evaluation. The decisive acceptance check is instead: The training cutoff precedes the first validation observation and a forward rolling evaluation reproduces the expected boundaries.
A sampled reconciliation shows expected one-to-many relationships and the final training row count meets the documented bounds. This would verify a different operation: Define an authoritative join key and a validated join cardinality before merging the two approved data sources. That separate action addresses: An ML team combines order data from RDS and session data from S3 without a stable customer join key and accidentally multiplies training rows. It cannot establish the required Timberline Foods correction for: A time-series demand model shuffles future demand records into an earlier training window, invalidating its forward-looking evaluation. The decisive acceptance check is instead: The training cutoff precedes the first validation observation and a forward rolling evaluation reproduces the expected boundaries.