Question 290
Spark jobs are short on executor memory for their actual data volume. Which engineering decision is most suitable for this specific situation?
Explanation
Correct Answer
Sufficient compatible executor memory can reduce spills and failures.
Incorrect Answers
Redistribution prevents one worker from becoming a straggler.
Broadcasting small lookup data can avoid shuffling the large fact.
Excess tiny tasks add scheduling overhead.