Question 50
An analytics team builds bronze-to-gold data products with Lakeflow Spark Declarative Pipelines. Engineers have applied Read the incremental source into a streaming table instead of overwriting a static table. Which result establishes the required behavior: A target needs append-only ingestion rather than destructive daily replacement?
Explanation
Correct Answer
A second update adds new source rows without replacing prior accepted rows is the matching outcome for the implemented control (Read the incremental source into a streaming table instead of overwriting a static table) and the stated requirement “A target needs append-only ingestion rather than destructive daily replacement.”
Incorrect Answers
That observation is a valid indicator for “A pipeline must ingest a stream from supported cloud files with Auto Loader” when using Use the Auto Loader `cloudFiles` streaming source in a pipeline dataset. The scenario instead tests “A target needs append-only ingestion rather than destructive daily replacement”; the relevant result is A second update adds new source rows without replacing prior accepted rows.
This signal belongs to the adjacent case “A streaming table should preserve append-only raw events rather than reaggregate the entire source,” whose remedy is Define a streaming table over an append-only supported source. The observed result for the present requirement is A second update adds new source rows without replacing prior accepted rows.
That observation is a valid indicator for “An intermediate dataset should automatically refresh when upstream dependencies change” when using Declare its streaming table or materialized view with a dependency on the source dataset. The scenario instead tests “A target needs append-only ingestion rather than destructive daily replacement”; the relevant result is A second update adds new source rows without replacing prior accepted rows.