Question 600
At the Westwick manufacturing vision team, training traffic depends on one top-of-rack switch with no supported failure alternative for a long-running job. What continuing safeguard is most appropriate?
Explanation
Correct Answer
This practice addresses future change, not just today’s incident. The team should review link health and failure-domain coverage following expansion because a single failed switching component can interrupt distributed training even when all accelerators remain healthy. This directly addresses the reported issue at the Westwick manufacturing vision team.
Incorrect Answers
This routine applies to training all-reduce fabric requirement, but it does not maintain the specific correction needed for the problem at the Westwick manufacturing vision team.
That practice helps control a different risk: a service provider owning physical infrastructure does not automatically operate every customer software component. The recurring control here should be to review link health and failure-domain coverage following expansion. For the Westwick manufacturing vision team, the priority is to choose fabric redundancy and recovery behavior consistent with the workload and acceptable interruption window.
This maintenance work is reasonable for floor loading and rack mass. The continuing exposure described here is that a single failed switching component can interrupt distributed training even when all accelerators remain healthy. For the Westwick manufacturing vision team, the priority is to choose fabric redundancy and recovery behavior consistent with the workload and acceptable interruption window.