Question 410
The reliability team at Mercury Travel Tech is closing a corrective-action ticket for this ML failure: A tabular tree ensemble is assigned to expensive GPUs despite its demonstrated strong CPU performance and a limited daily training budget. Which independently observable result best verifies that the remediation works?
Explanation
Correct Answer
The CPU training configuration meets the job deadline and lowers measured compute spend without quality loss. This controlled observation specifically validates the proposed remedy: Benchmark a suitable CPU machine shape for the tree workload and select resources by measured performance per cost. It addresses the documented failure at Mercury Travel Tech: A tabular tree ensemble is assigned to expensive GPUs despite its demonstrated strong CPU performance and a limited daily training budget.
Incorrect Answers
Cross-replica parameter checks match within tolerance after optimizer steps and effective global batch is documented. This is evidence for a different corrective change: Implement correct data-parallel sharding and synchronized gradient aggregation for the chosen distributed framework. That other change addresses: A distributed run repeats the entire dataset independently on every GPU and never aggregates gradients, yielding divergent model replicas. It does not validate the specific Mercury Travel Tech remediation for: A tabular tree ensemble is assigned to expensive GPUs despite its demonstrated strong CPU performance and a limited daily training budget. The necessary check instead is: The CPU training configuration meets the job deadline and lowers measured compute spend without quality loss.
The optimized model fits target memory and meets the device-specific latency and accuracy floors. This is evidence for a different corrective change: Evaluate distillation or quantization for the deployment target with a representative on-device test. That other change addresses: An edge inference model exceeds the device memory budget although the training data and accuracy baseline are sound. It does not validate the specific Mercury Travel Tech remediation for: A tabular tree ensemble is assigned to expensive GPUs despite its demonstrated strong CPU performance and a limited daily training budget. The necessary check instead is: The CPU training configuration meets the job deadline and lowers measured compute spend without quality loss.
Collective trace time decreases and per-step utilization improves at equal effective batch size. This is evidence for a different corrective change: Profile collective communication and choose an appropriate network topology or reduce synchronization overhead. That other change addresses: A multi-GPU training job has near-idle accelerators during gradient synchronization due to a slow network interconnect. It does not validate the specific Mercury Travel Tech remediation for: A tabular tree ensemble is assigned to expensive GPUs despite its demonstrated strong CPU performance and a limited daily training budget. The necessary check instead is: The CPU training configuration meets the job deadline and lowers measured compute spend without quality loss.