Question 750
At Westhaven Retail, the commerce ML platform team maintains customer churn and inventory recommendation models under requirements for stable online features and production rollback. The production acceptance reviewer checks a proposed fix for: Production predictions fail silently during a partial downstream feature outage while endpoint uptime remains normal. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
A simulated stale feature feed triggers a dependency alarm even though the SageMaker endpoint remains available. This is observable proof for correction of: Production predictions fail silently during a partial downstream feature outage while endpoint uptime remains normal. The approved design change is: Monitor end-to-end feature freshness, dependency errors and successful business prediction rates in addition to endpoint health. The Westhaven Retail acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A training role cannot approve its own model package and a designated release role can promote a reviewed version. This would verify a different operation: Separate training, model approval and production deployment identities with explicit role and approval boundaries. That separate action addresses: A machine learning pipeline uses a single IAM role to train models, approve registry packages and update production endpoints. It cannot establish the required Westhaven Retail correction for: Production predictions fail silently during a partial downstream feature outage while endpoint uptime remains normal. The decisive acceptance check is instead: A simulated stale feature feed triggers a dependency alarm even though the SageMaker endpoint remains available.
A tagged cost breakdown identifies the new resource responsible for the measured increase and supports an accountable remediation. This would verify a different operation: Use AWS Cost Explorer and properly applied resource tags to compare endpoint, training and storage cost changes over time. That separate action addresses: An operations team tracks aggregate monthly AWS charges but cannot isolate a sudden cost increase to new model endpoints. It cannot establish the required Westhaven Retail correction for: Production predictions fail silently during a partial downstream feature outage while endpoint uptime remains normal. The decisive acceptance check is instead: A simulated stale feature feed triggers a dependency alarm even though the SageMaker endpoint remains available.
The nightly workload still meets its completion target while cost reports show reduced idle serving hours. This would verify a different operation: Measure invocation patterns and replace unnecessary continuous capacity with supported scheduled batch or appropriately scaled alternatives. That separate action addresses: An inference workload maintains two always-on high-memory SageMaker endpoints for models invoked only during a brief nightly window. It cannot establish the required Westhaven Retail correction for: Production predictions fail silently during a partial downstream feature outage while endpoint uptime remains normal. The decisive acceptance check is instead: A simulated stale feature feed triggers a dependency alarm even though the SageMaker endpoint remains available.