Question 670
At Harborline Logistics, the optimization engineers maintain shipment routing and estimated-arrival models under requirements for fresh source data and resilient endpoints. Following the controlled change, the team validates: A quality gate evaluates only global F1 score while a new candidate violates the acceptable error limit for a protected segment. Which observed result BEST demonstrates that the correction works?
Explanation
Correct Answer
A test candidate with a critical slice regression is blocked despite acceptable aggregate F1 performance. This is observable proof for correction of: A quality gate evaluates only global F1 score while a new candidate violates the acceptable error limit for a protected segment. The approved design change is: Include explicitly approved per-segment acceptance checks and fairness review in the conditional deployment gates. The Harborline Logistics acceptance test separates measured ML behavior from an unverified implementation claim.
Incorrect Answers
A rebuilt image contains no credential strings and a task retrieves only its authorized secret at runtime. This would verify a different operation: Remove embedded credentials and use least-privilege runtime IAM roles or approved secret injection with image scanning. That separate action addresses: An ML microservice container stores credentials in its Dockerfile and the image is uploaded to a shared ECR repository. It cannot establish the required Harborline Logistics correction for: A quality gate evaluates only global F1 score while a new candidate violates the acceptable error limit for a protected segment. The decisive acceptance check is instead: A test candidate with a critical slice regression is blocked despite acceptable aggregate F1 performance.
A synthetic peak test reaches the latency objective while instance count scales back after demand subsides. This would verify a different operation: Choose autoscaled real-time hosting with appropriate minimum capacity and measured scaling response to the traffic pattern. That separate action addresses: An inference workload receives highly variable request bursts and a fixed number of endpoint instances causes long queues at peak. It cannot establish the required Harborline Logistics correction for: A quality gate evaluates only global F1 score while a new candidate violates the acceptable error limit for a protected segment. The decisive acceptance check is instead: A test candidate with a critical slice regression is blocked despite acceptable aggregate F1 performance.
The test traffic follows the approved proportion and logs identify exactly which model variant served each request. This would verify a different operation: Use a governed endpoint-variant routing or other supported traffic allocation design with versioned model identifiers. That separate action addresses: A product runs several model variants but the frontend hard-codes one endpoint URL and cannot safely direct a controlled share of traffic to a candidate. It cannot establish the required Harborline Logistics correction for: A quality gate evaluates only global F1 score while a new candidate violates the acceptable error limit for a protected segment. The decisive acceptance check is instead: A test candidate with a critical slice regression is blocked despite acceptable aggregate F1 performance.