Question 250
At a recruitment services group in Dublin, the team needs acceptance evidence for a fix to this concern: A hiring classifier passed predeployment bias tests, but no one checks whether group error rates shift after launch. Which observed result MOST directly demonstrates control effectiveness?
Explanation
Correct Answer
This is the acceptance result specific to production fairness monitoring. It shows whether the corrective action, 'Track applicable group-level performance and disparity measures over time with escalation thresholds', is working for the documented gap at a recruitment services group in Dublin. The original issue was: A hiring classifier passed predeployment bias tests, but no one checks whether group error rates shift after launch.
Incorrect Answers
This result would support maintenance after drift, a distinct governance need illustrated by: A deployed forecasting model gradually deteriorates, but updates are scheduled only annually regardless of monitoring results. For the reported production fairness monitoring issue at a recruitment services group in Dublin, the relevant corrective action is: Track applicable group-level performance and disparity measures over time with escalation thresholds. The offered observation does not establish whether that targeted control succeeded.
This result would support secondary use prevention, a distinct governance need illustrated by: A model built for service support is later reused for employee performance scoring without any new impact assessment. For the reported production fairness monitoring issue at a recruitment services group in Dublin, the relevant corrective action is: Track applicable group-level performance and disparity measures over time with escalation thresholds. The offered observation does not establish whether that targeted control succeeded.
This result would support near-miss reporting, a distinct governance need illustrated by: Users report several close calls where an AI system nearly caused harm, but incidents are recorded only when actual loss occurs. For the reported production fairness monitoring issue at a recruitment services group in Dublin, the relevant corrective action is: Track applicable group-level performance and disparity measures over time with escalation thresholds. The offered observation does not establish whether that targeted control succeeded.