Question 170
A data-quality platform tests source records before promoting them to silver tables. Engineers have applied Narrow the expectation predicate to the required mandatory fields. Which result establishes the required behavior: An existing expectation is too broad and flags legitimate nulls in an optional attribute?
Explanation
Correct Answer
The acceptance criterion for “An existing expectation is too broad and flags legitimate nulls in an optional attribute” is Valid optional-null rows pass while null mandatory fields are flagged; this is the expected evidence after Narrow the expectation predicate to the required mandatory fields.
Incorrect Answers
This signal belongs to the adjacent case “A raw events dataset must remove exact duplicate records without altering other fields,” whose remedy is Apply a full-record DISTINCT projection to the intended columns. The observed result for the present requirement is Valid optional-null rows pass while null mandatory fields are flagged.
That observation is a valid indicator for “A full snapshot source is authoritative and the target should delete keys absent from it” when using Use a carefully scoped `WHEN NOT MATCHED BY SOURCE THEN DELETE` clause. The scenario instead tests “An existing expectation is too broad and flags legitimate nulls in an optional attribute”; the relevant result is Valid optional-null rows pass while null mandatory fields are flagged.
Quarantine contains the rejected records and silver contains only valid records pertains to a different control (Write a separate selection of failing rows to a quarantine target while the clean flow filters them) and a different need (Bad records must be preserved in a separate quarantine dataset). It cannot establish that Narrow the expectation predicate to the required mandatory fields met the stated goal.