Question 630
A reporting query joins a large fact with several dimensions. An auditor must prove the outcome of Allow a suitable sort-merge or supported shuffle join plan for this requirement: Two large datasets need a join and memory pressure makes forced broadcast impractical. Which test result is best?
Explanation
Correct Answer
The join completes without broadcast OOM and returns correct cardinality is the matching outcome for the implemented control (Allow a suitable sort-merge or supported shuffle join plan) and the stated requirement “Two large datasets need a join and memory pressure makes forced broadcast impractical.”
Incorrect Answers
This signal belongs to the adjacent case “A join's keys are heavily skewed to one customer ID,” whose remedy is Rebalance skew using supported AQE/skew mitigation or targeted salting. The observed result for the present requirement is The join completes without broadcast OOM and returns correct cardinality.
That observation is a valid indicator for “The join creates a Cartesian product because the ON predicate was omitted” when using Correct the equality/range join condition for the business keys. The scenario instead tests “Two large datasets need a join and memory pressure makes forced broadcast impractical”; the relevant result is The join completes without broadcast OOM and returns correct cardinality.
That observation is a valid indicator for “A query shuffles a huge wide DataFrame before filtering unneeded rows” when using Push semantically safe filters and projections ahead of the shuffle. The scenario instead tests “Two large datasets need a join and memory pressure makes forced broadcast impractical”; the relevant result is The join completes without broadcast OOM and returns correct cardinality.