Question 10
Following a proposed change in a cross-team productivity initiative at Eastshore Education, the workforce productivity team reports that it addressed the following need under an upcoming readiness review: An operations group has no outcome labels but wants to discover natural groups of support requests. Which observation provides the STRONGEST evidence that the change worked?
Explanation
Correct Answer
Clusters reflect measurable similarities and domain experts validate whether the groupings are useful. This is the direct observable test of the intended response: Apply unsupervised clustering or representation analysis to find patterns before assigning business interpretations. In the context of Eastshore Education's a cross-team productivity initiative, it checks an actual outcome instead of treating completion of a project ticket or an untested assertion as evidence.
Incorrect Answers
Pipeline evidence shows validated data flowing through each lifecycle stage with documented gates. This would instead validate the different situation: A sponsor proposes deploying a model before source data has been ingested and validated. It would ordinarily follow the action: Sequence data ingestion and preparation before training, evaluation, deployment, and ongoing management. It does not establish that Eastshore Education solved the need specified in this scenario; the relevant check is: Clusters reflect measurable similarities and domain experts validate whether the groupings are useful.
A documented holdout evaluation exposes performance beyond memorized training records. This would instead validate the different situation: A model looks excellent on training examples but its team has not tested unseen cases. It would ordinarily follow the action: Reserve suitable validation and test data and evaluate generalization before deploying the model. It does not establish that Eastshore Education solved the need specified in this scenario; the relevant check is: Clusters reflect measurable similarities and domain experts validate whether the groupings are useful.
The approved use-case inventory correctly classifies predictive and generative tasks. This would instead validate the different situation: A leadership slide calls all analytics and decision automation generative AI even when systems only classify fixed categories. It would ordinarily follow the action: Distinguish AI broadly, machine learning prediction, and generative content production when scoping each use case. It does not establish that Eastshore Education solved the need specified in this scenario; the relevant check is: Clusters reflect measurable similarities and domain experts validate whether the groupings are useful.