Question 540
During a GPU datacenter maintenance window, an engineer discovers: A server resets during large batch inference and logs show power-input drops but no GPU ECC anomalies; operators propose reinstalling CUDA. Which repeatable operational safeguard best prevents recurrence of this failure?
Explanation
Correct Answer
This preventive practice addresses the underlying failure (Power delivery faults can produce workload-triggered host resets that software reinstallations do not correct.) and supports continued assurance through: A controlled peak-load run completes with stable PSU input and no BMC power-reset events after electrical remediation.
Incorrect Answers
This prevention control targets another operational risk: An eight-GPU server drops out of training during peak workload and BMC logs show a fan failure, while `nvidia-smi` reports temperature alarms on two cards. The currently reported mechanism remains: Power delivery faults can produce workload-triggered host resets that software reinstallations do not correct.
This prevention control targets another operational risk: A distributed job loses one host intermittently, and the suspect node's ConnectX adapter records rising physical errors while its GPUs pass isolated compute tests. The currently reported mechanism remains: Power delivery faults can produce workload-triggered host resets that software reinstallations do not correct.
This prevention control targets another operational risk: A GPU fails during production training and a field technician opens the energized chassis without following the vendor's power and electrostatic discharge procedure. The currently reported mechanism remains: Power delivery faults can produce workload-triggered host resets that software reinstallations do not correct.