Question 540
At the Birchhaven energy forecasting provider, loss of one scheduling controller prevents all new GPU jobs and stops operational control for hours. What continuing safeguard is most appropriate?
Explanation
Correct Answer
This practice addresses future change, not just today’s incident. The team should rehearse configuration backups and controller recovery during maintenance because the compute fleet depends on management services for provisioning and scheduling even if GPUs remain healthy. This directly addresses the reported issue at the Birchhaven energy forecasting provider.
Incorrect Answers
This routine applies to cluster management network, but it does not maintain the specific correction needed for the problem at the Birchhaven energy forecasting provider.
That practice helps control a different risk: high-volume east-west accelerator transfers can interfere with operational control services. The recurring control here should be to rehearse configuration backups and controller recovery during maintenance. For the Birchhaven energy forecasting provider, the priority is to implement management service redundancy or recoverability appropriate to the cluster availability target.
This maintenance work is reasonable for remote direct memory access concept. The continuing exposure described here is that the compute fleet depends on management services for provisioning and scheduling even if GPUs remain healthy. For the Birchhaven energy forecasting provider, the priority is to implement management service redundancy or recoverability appropriate to the cluster availability target.