Question 240
A manufacturing platform receives dated files from partner cloud object storage. The team implements Require producer-side atomic finalization or a stable file arrival protocol. The goal was: A source writes partially constructed objects that should not be ingested until finalized. Which observed result best verifies success?
Explanation
Correct Answer
Only completed object versions enter the accepted ingestion batch directly measures whether Require producer-side atomic finalization or a stable file arrival protocol achieved the requirement “A source writes partially constructed objects that should not be ingested until finalized.” It checks the operating result rather than just a configured resource name.
Incorrect Answers
A second run processes only newly discovered files pertains to a different control (Use Auto Loader with a durable schema location and checkpoint) and a different need (New files must be incrementally processed without listing every historical object each time). It cannot establish that Require producer-side atomic finalization or a stable file arrival protocol met the stated goal.
That observation is a valid indicator for “A job must load a finite set of source files into an existing Delta table without persistent streaming” when using Use supported `COPY INTO` with the source path and format. The scenario instead tests “A source writes partially constructed objects that should not be ingested until finalized”; the relevant result is Only completed object versions enter the accepted ingestion batch.
This signal belongs to the adjacent case “Files arrive repeatedly and source discovery should scale beyond directory listing,” whose remedy is Use Auto Loader managed file-event notification mode where supported. The observed result for the present requirement is Only completed object versions enter the accepted ingestion batch.