Question 600
A Delta table receives thousands of tiny microbatch writes per hour. An auditor must prove the outcome of Choose a balanced target file size and tune supported write optimization for this requirement: Very large files cause poor parallelism for typical query scans. Which test result is best?
Explanation
Correct Answer
The acceptance criterion for “Very large files cause poor parallelism for typical query scans” is Queries use enough scan tasks without excessive file-open overhead; this is the expected evidence after Choose a balanced target file size and tune supported write optimization.
Incorrect Answers
This signal belongs to the adjacent case “Queries spend excessive time opening small files after frequent appends,” whose remedy is Run `OPTIMIZE` or enable supported automatic compaction. The observed result for the present requirement is Queries use enough scan tasks without excessive file-open overhead.
This signal belongs to the adjacent case “A daily writer creates millions of tiny partitions from a high-cardinality identifier,” whose remedy is Remove pathological partitioning and redesign data layout. The observed result for the present requirement is Queries use enough scan tasks without excessive file-open overhead.
Reads see consistent table versions before and after compaction would demonstrate the separate action Use supported Delta OPTIMIZE rather than directly rewriting the data directory, which addresses “A table needs to preserve transaction correctness during physical file compaction.” It does not verify the requirement “Very large files cause poor parallelism for typical query scans” following Choose a balanced target file size and tune supported write optimization.