Question 690
At Lakeside Research, the applied ML group maintains anonymized scientific datasets and repeatable experiments under requirements for auditable lineage and reproducible predictions. The production acceptance reviewer checks a proposed fix for: A production classifier's false-negative rate rises over several months, but predictions are logged without collecting any eventual ground-truth outcomes. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
A reference set with known labels produces a measurable recall trend and an agreed quality alert fires when the threshold is breached. This is observable proof for correction of: A production classifier's false-negative rate rises over several months, but predictions are logged without collecting any eventual ground-truth outcomes. The approved design change is: Create a governed delayed-label collection path and compare production predictions with matched observed labels for model quality monitoring. The Lakeside Research acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A deliberately vulnerable test image is blocked and a compliant approved digest reaches the deployment stage. This would verify a different operation: Integrate ECR image scanning and an enforced reviewed vulnerability acceptance gate before deploying the immutable image digest. That separate action addresses: A training pipeline publishes an unscanned container image with known vulnerable dependencies directly to the production ECR repository. It cannot establish the required Lakeside Research correction for: A production classifier's false-negative rate rises over several months, but predictions are logged without collecting any eventual ground-truth outcomes. The decisive acceptance check is instead: A reference set with known labels produces a measurable recall trend and an agreed quality alert fires when the threshold is breached.
A test model role reads its permitted subset and is denied access to unrelated original customer attributes. This would verify a different operation: Publish an approved data subset or governed view and grant read access only to the required machine learning project roles. That separate action addresses: A team shares a full customer dataset across projects by broadening S3 bucket access instead of providing a minimally scoped training extract. It cannot establish the required Lakeside Research correction for: A production classifier's false-negative rate rises over several months, but predictions are logged without collecting any eventual ground-truth outcomes. The decisive acceptance check is instead: A reference set with known labels produces a measurable recall trend and an agreed quality alert fires when the threshold is breached.
The production role loads the shared artifact and a separate untrusted account still receives an access denial. This would verify a different operation: Configure precise cross-account package, S3 and KMS key permissions for the trusted production consumer role. That separate action addresses: A cross-account model registry package is shared with a production account but the referenced encrypted S3 model artifact cannot be decrypted there. It cannot establish the required Lakeside Research correction for: A production classifier's false-negative rate rises over several months, but predictions are logged without collecting any eventual ground-truth outcomes. The decisive acceptance check is instead: A reference set with known labels produces a measurable recall trend and an agreed quality alert fires when the threshold is breached.