Question 780
At Eastshore Energy, the ML infrastructure engineers maintain equipment failure scoring and energy demand forecasts under requirements for fault-tolerant automation and cost visibility. The production acceptance reviewer checks a proposed fix for: A CloudWatch dashboard claims the inference host is idle because CPU is low, yet GPU memory saturation causes inference throttling. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
The benchmark identifies the accelerator bottleneck and the selected corrective capacity change reduces inference failures. This is observable proof for correction of: A CloudWatch dashboard claims the inference host is idle because CPU is low, yet GPU memory saturation causes inference throttling. The approved design change is: Monitor the appropriate GPU utilization, memory and throughput metrics for the selected hosting architecture. The Eastshore Energy acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A controlled personal-data request produces timing and error records without the prohibited raw identifiers. This would verify a different operation: Redact or omit sensitive input fields from logs and emit privacy-safe structured metadata with governed retention. That separate action addresses: An inference endpoint logs complete customer request bodies including personal information even though troubleshooting needs only aggregate timings. It cannot establish the required Eastshore Energy correction for: A CloudWatch dashboard claims the inference host is idle because CPU is low, yet GPU memory saturation causes inference throttling. The decisive acceptance check is instead: The benchmark identifies the accelerator bottleneck and the selected corrective capacity change reduces inference failures.
A controlled malformed-input batch is counted in the rejection metric and overall error reporting includes all attempted records. This would verify a different operation: Track total received records, rejected records and successful predictions with clear denominators across batch processing. That separate action addresses: A batch prediction system drops malformed records but the monitoring report tracks only successfully scored inputs and understates total error rate. It cannot establish the required Eastshore Energy correction for: A CloudWatch dashboard claims the inference host is idle because CPU is low, yet GPU memory saturation causes inference throttling. The decisive acceptance check is instead: The benchmark identifies the accelerator bottleneck and the selected corrective capacity change reduces inference failures.
A controlled prediction from the new variant appears in the correct monitoring dataset and the old variant is not mistaken for current. This would verify a different operation: Update monitored endpoint or variant configuration and baseline references as part of the versioned deployment process. That separate action addresses: A risk model is deployed with a new model version but its SageMaker Model Monitor schedule continues capturing only the old endpoint variant. It cannot establish the required Eastshore Energy correction for: A CloudWatch dashboard claims the inference host is idle because CPU is low, yet GPU memory saturation causes inference throttling. The decisive acceptance check is instead: The benchmark identifies the accelerator bottleneck and the selected corrective capacity change reduces inference failures.