Question 30
A Spark batch has a fixed processing window but the team chose a low-memory single-node development cluster for terabyte-scale joins. Which result should determine whether the change is accepted?
Explanation
Correct Answer
This outcome directly verifies the scenario's required behavior: distributed executors and sufficient memory support parallel wide transformations.
Incorrect Answers
Cross joins multiply rows and exacerbate computation.
UI waits do not add execution resources.
Driver-local collection creates a memory bottleneck for terabyte data.