Question 350
A team ingests partner transaction messages and must recover from malformed records. Engineers have applied Preserve immutable bronze input and rerun corrected transformations under controlled refresh. Which result establishes the required behavior: The pipeline must reconstruct curated silver tables after a logic bug without losing source history?
Explanation
Correct Answer
The team used Preserve immutable bronze input and rerun corrected transformations under controlled refresh to fulfill “The pipeline must reconstruct curated silver tables after a logic bug without losing source history.” Observing Rebuilt silver counts match the expected corrected output from bronze confirms the intended effect in the resulting workload.
Incorrect Answers
The run fails with an explicit invalid-key error before promoting corrupt rows pertains to a different control (Apply a strict expectation on non-null transaction keys) and a different need (An ingestion batch must fail when mandatory transaction identifiers are missing). It cannot establish that Preserve immutable bronze input and rerun corrected transformations under controlled refresh met the stated goal.
This signal belongs to the adjacent case “Corrupt JSON records must be preserved for investigation instead of silently dropped,” whose remedy is Capture malformed payloads in a quarantine or rescued data target. The observed result for the present requirement is Rebuilt silver counts match the expected corrected output from bronze.
The sink contains one logical record per event even after replay pertains to a different control (Rely on checkpointed ingestion and a deduplicated business key as appropriate) and a different need (An upstream partner re-sends the same file after a network timeout). It cannot establish that Preserve immutable bronze input and rerun corrected transformations under controlled refresh met the stated goal.