Question 650
At Cedarfield Hospitality, the revenue analytics engineers maintain hotel occupancy prediction and customer service classification under requirements for controlled deployment costs and reliable features. The ML reliability team requests proof of the remediation for: A model's automatic deployment increases error rates, but the pipeline has no health-driven rollback condition or retained previous version. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
A simulated bad candidate triggers the rollback and the restored endpoint returns the documented prior model responses. This is observable proof for correction of: A model's automatic deployment increases error rates, but the pipeline has no health-driven rollback condition or retained previous version. The approved design change is: Implement a controlled canary or blue-green rollout with CloudWatch alarm gates and automatic rollback to the approved prior version. The Cedarfield Hospitality acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A fresh ECS task passes its health check and serves a controlled request without depending on SageMaker-only paths. This would verify a different operation: Adapt the container entrypoint, model artifact retrieval and health interface to the actual selected ECS deployment environment. That separate action addresses: A new model is deployed to ECS but its container expects SageMaker environment paths and does not satisfy the container orchestration service's HTTP health contract. It cannot establish the required Cedarfield Hospitality correction for: A model's automatic deployment increases error rates, but the pipeline has no health-driven rollback condition or retained previous version. The decisive acceptance check is instead: A simulated bad candidate triggers the rollback and the restored endpoint returns the documented prior model responses.
A known request traverses the versioned preprocessing and prediction stages and produces the expected output after deployment. This would verify a different operation: Use a supported SageMaker inference pipeline or reviewed multi-container design with compatible input and output contracts. That separate action addresses: An inference service chains preprocessing and prediction in application code that cannot be versioned with the SageMaker deployed model. It cannot establish the required Cedarfield Hospitality correction for: A model's automatic deployment increases error rates, but the pipeline has no health-driven rollback condition or retained previous version. The decisive acceptance check is instead: A simulated bad candidate triggers the rollback and the restored endpoint returns the documented prior model responses.
A repeated deployment selects the identical container digest and verified model artifact regardless of later tag updates. This would verify a different operation: Reference a reviewed immutable ECR image digest alongside the exact model artifact version in the deployment configuration. That separate action addresses: A deployment includes an inference image tagged latest in Amazon ECR, allowing a later push to silently change model runtime dependencies. It cannot establish the required Cedarfield Hospitality correction for: A model's automatic deployment increases error rates, but the pipeline has no health-driven rollback condition or retained previous version. The decisive acceptance check is instead: A simulated bad candidate triggers the rollback and the restored endpoint returns the documented prior model responses.