Question 720
At Pinecrest Hotels, the guest-services ML team maintains demand and booking anomaly prediction under requirements for timely forecasts and protected guest attributes. The production acceptance reviewer checks a proposed fix for: A model monitoring job alerts on every small weekly seasonal variation and overwhelms operators despite meeting business quality requirements. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
A normal seasonal replay stays below the reviewed alert threshold and an injected abnormal shift still produces an alert. This is observable proof for correction of: A model monitoring job alerts on every small weekly seasonal variation and overwhelms operators despite meeting business quality requirements. The approved design change is: Define seasonal reference windows and calibrated drift thresholds rather than using an inappropriate static training baseline for all periods. The Pinecrest Hotels acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
Cost Explorer separates test and production project charges by approved tags without assigning shared costs to the wrong team. This would verify a different operation: Apply consistent project, environment and model cost-allocation tags and activate the corresponding billing reports. That separate action addresses: A team attributes all SageMaker training expenses to a shared account and cannot explain spending differences across model projects. It cannot establish the required Pinecrest Hotels correction for: A model monitoring job alerts on every small weekly seasonal variation and overwhelms operators despite meeting business quality requirements. The decisive acceptance check is instead: A normal seasonal replay stays below the reviewed alert threshold and an injected abnormal shift still produces an alert.
The inference container accesses authorized model artifacts privately and an external egress test remains blocked. This would verify a different operation: Use approved private subnets, security groups and VPC endpoints where supported to restrict unnecessary network egress. That separate action addresses: A production inference container is placed in subnets with internet egress although its required datasets and dependencies are private AWS services. It cannot establish the required Pinecrest Hotels correction for: A model monitoring job alerts on every small weekly seasonal variation and overwhelms operators despite meeting business quality requirements. The decisive acceptance check is instead: A normal seasonal replay stays below the reviewed alert threshold and an injected abnormal shift still produces an alert.
The runtime writes to the intended log stream but cannot modify an unrelated service's logging resources. This would verify a different operation: Scope CloudWatch log actions to required resource ARNs and separate log configuration permissions from ordinary invocation needs. That separate action addresses: A model deployment can write arbitrary CloudWatch Logs groups because its inference IAM role includes broad administrative logging permissions. It cannot establish the required Pinecrest Hotels correction for: A model monitoring job alerts on every small weekly seasonal variation and overwhelms operators despite meeting business quality requirements. The decisive acceptance check is instead: A normal seasonal replay stays below the reviewed alert threshold and an injected abnormal shift still produces an alert.