Question 570
At a software services vendor in Lisbon, the team needs acceptance evidence for a fix to this concern: A risk-scoring tool is deployed with generic feature-importance plots that have not been tested for stability or usefulness. Which observed result MOST directly demonstrates control effectiveness?
Explanation
Correct Answer
This is the acceptance result specific to model interpretability checks. It shows whether the corrective action, 'Evaluate whether interpretability methods are reliable and meaningful for the actual oversight task', is working for the documented gap at a software services vendor in Lisbon. The original issue was: A risk-scoring tool is deployed with generic feature-importance plots that have not been tested for stability or usefulness.
Incorrect Answers
This result would support bias mitigation validation, a distinct governance need illustrated by: A team changes training weights to address one group's error disparity without checking if performance worsened for others. For the reported model interpretability checks issue at a software services vendor in Lisbon, the relevant corrective action is: Evaluate whether interpretability methods are reliable and meaningful for the actual oversight task. The offered observation does not establish whether that targeted control succeeded.
This result would support class-imbalance testing, a distinct governance need illustrated by: A rare safety incident makes up very little of a dataset, but the team celebrates a high overall accuracy score. For the reported model interpretability checks issue at a software services vendor in Lisbon, the relevant corrective action is: Evaluate whether interpretability methods are reliable and meaningful for the actual oversight task. The offered observation does not establish whether that targeted control succeeded.
This result would support adversarial robustness, a distinct governance need illustrated by: An image model passes clean benchmarks but fails when small realistic perturbations are introduced. For the reported model interpretability checks issue at a software services vendor in Lisbon, the relevant corrective action is: Evaluate whether interpretability methods are reliable and meaningful for the actual oversight task. The offered observation does not establish whether that targeted control succeeded.