Question 110
At Redstone Aviation, the technical operations ML group maintains fleet maintenance forecasting and scheduling models under requirements for high-availability serving and safety-reviewed changes. The ML reliability team requests proof of the remediation for: A data-wrangling job treats all high-value transactions as outliers and deletes legitimate rare fraud cases critical to model recall. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
The retained training sample preserves known rare positives and a held-out fraud recall check remains within the target band. This is observable proof for correction of: A data-wrangling job treats all high-value transactions as outliers and deletes legitimate rare fraud cases critical to model recall. The approved design change is: Profile the feature distribution by label and apply documented context-aware outlier handling rather than global blind filtering. The Redstone Aviation acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A measured extract contains only authorized columns and the intended time window while transfer volume decreases. This would verify a different operation: Push filters and projections into an appropriate query or unload operation before delivering selected fields to the training pipeline. That separate action addresses: A distributed feature preparation process overfetches every Redshift table column even though the model uses just a few features and one time period. It cannot establish the required Redstone Aviation correction for: A data-wrangling job treats all high-value transactions as outliers and deletes legitimate rare fraud cases critical to model recall. The decisive acceptance check is instead: The retained training sample preserves known rare positives and a held-out fraud recall check remains within the target band.
Subsequent readers select the newly committed version and no partial object contents are exposed as an accepted input. This would verify a different operation: Change the workflow to write complete immutable S3 objects and publish a new object or manifest version instead of POSIX-style append. That separate action addresses: A data ingestion script assumes S3 is a POSIX filesystem and tries in-place append operations on one object during batch preparation. It cannot establish the required Redstone Aviation correction for: A data-wrangling job treats all high-value transactions as outliers and deletes legitimate rare fraud cases critical to model recall. The decisive acceptance check is instead: The retained training sample preserves known rare positives and a held-out fraud recall check remains within the target band.
A rerun uses the same immutable S3 manifest and produces identical input checksums without public endpoint dependency. This would verify a different operation: Land a versioned, integrity-checked source copy in an authorized S3 data lake before launching repeatable processing jobs. That separate action addresses: A SageMaker processing job repeatedly downloads a multi-gigabyte model-input dataset from a distant public endpoint and fails on unstable external transfers. It cannot establish the required Redstone Aviation correction for: A data-wrangling job treats all high-value transactions as outliers and deletes legitimate rare fraud cases critical to model recall. The decisive acceptance check is instead: The retained training sample preserves known rare positives and a held-out fraud recall check remains within the target band.