Question 570
A team supports a medallion ETL pipeline with bronze, silver and gold outputs. Following Use supported Jobs task repair or selective pipeline retry where applicable, the incident team needs evidence that A pipeline failure needs targeted replay without rerunning unaffected upstream tasks. Which observation supports closure?
Explanation
Correct Answer
The acceptance criterion for “A pipeline failure needs targeted replay without rerunning unaffected upstream tasks” is Only the intended failed task/path reruns and downstream outputs are correct; this is the expected evidence after Use supported Jobs task repair or selective pipeline retry where applicable.
Incorrect Answers
That observation is a valid indicator for “Bronze ingest succeeds but silver quality checks suddenly drop many records” when using Inspect silver expectation metrics and rejected source samples. The scenario instead tests “A pipeline failure needs targeted replay without rerunning unaffected upstream tasks”; the relevant result is Only the intended failed task/path reruns and downstream outputs are correct.
A specific incompatible dependency/version is identified would demonstrate the separate action Review run environment versions and driver exception logs, which addresses “A production job fails only after a library was upgraded.” It does not verify the requirement “A pipeline failure needs targeted replay without rerunning unaffected upstream tasks” following Use supported Jobs task repair or selective pipeline retry where applicable.
Changed scan and shuffle costs explain the regression would demonstrate the separate action Inspect SQL query profile and pruning/scan metrics, which addresses “A lakehouse table read suddenly becomes slow after a data layout change.” It does not verify the requirement “A pipeline failure needs targeted replay without rerunning unaffected upstream tasks” following Use supported Jobs task repair or selective pipeline retry where applicable.