Question 370
A monitoring job compares ground truth from last month against today's predictions without matching dates. What must be corrected?
Explanation
Correct Answer
Time-mismatched outcomes yield misleading performance metrics and can trigger false release or retraining decisions.
Incorrect Answers
The alternative, Select regression-appropriate metrics such as MAE or RMSE, belongs to a different technical condition: A model monitor evaluates a regression task using classification precision, yielding meaningless reports. There the source-specific mechanism or proof is: Metrics must match task output semantics; classification precision does not measure continuous-value prediction error. The condition asked about here is: A monitoring job compares ground truth from last month against today's predictions without matching dates. A suitable correction is Align labels and predictions to the same events and appropriate observation window; the targeted justification or result is: Time-mismatched outcomes yield misleading performance metrics and can trigger false release or retraining decisions.
Monitor request error rates by endpoint deployment and revision. That operation would be relevant if: An anomaly classifier has stable throughput but suddenly returns more HTTP 5xx errors after deployment. Its corresponding reason or verification is: Transport and scoring failures can increase independently of traffic volume or offline model accuracy. However the problem in this question is: A monitoring job compares ground truth from last month against today's predictions without matching dates. The requirement instead calls for Align labels and predictions to the same events and appropriate observation window; the question-specific check is: Time-mismatched outcomes yield misleading performance metrics and can trigger false release or retraining decisions.
Investigate prediction quality changes using ground truth and input distribution evidence. A separate source case supports that approach when: A model's observed mean squared error increases sharply although its API health remains green. The supporting rationale or observable result is: A model can return successful responses while making increasingly inaccurate predictions as real-world conditions change. This question describes a different issue: A monitoring job compares ground truth from last month against today's predictions without matching dates. Address it through Align labels and predictions to the same events and appropriate observation window, with the required justification or evidence: Time-mismatched outcomes yield misleading performance metrics and can trigger false release or retraining decisions.