Question 410
A service uses approved Databricks AI functions to classify business text under governance controls. A reviewer sees that engineers chose Evaluate outputs against curated labeled test records and track a quality metric. To verify AI-generated labels are inconsistent and need acceptance evidence, what should the reviewer observe?
Explanation
Correct Answer
The team used Evaluate outputs against curated labeled test records and track a quality metric to fulfill “AI-generated labels are inconsistent and need acceptance evidence.” Observing Regression tests detect a change in label accuracy or format compliance confirms the intended effect in the resulting workload.
Incorrect Answers
This signal belongs to the adjacent case “A personal-data column must not be sent to an unapproved inference endpoint,” whose remedy is Mask or exclude protected fields and use approved governed model access. The observed result for the present requirement is Regression tests detect a change in label accuracy or format compliance.
This signal belongs to the adjacent case “A model response is free text but downstream processing requires a strict schema,” whose remedy is Validate and parse the model response against an explicit output contract. The observed result for the present requirement is Regression tests detect a change in label accuracy or format compliance.
That observation is a valid indicator for “AI results should not be recomputed for every dashboard query” when using Materialize validated model outputs in a governed table on a controlled schedule. The scenario instead tests “AI-generated labels are inconsistent and need acceptance evidence”; the relevant result is Regression tests detect a change in label accuracy or format compliance.