Question 710
At the Northbridge fraud analytics department, while planning an accelerator expansion, a deep neural network is partitioned by layers across GPUs but devices remain idle while waiting for sequential stages. What is the most significant cause of this behavior?
Explanation
Correct Answer
The issue is not simply a failed task; naive stage-by-stage execution can leave most devices waiting instead of sharing useful work. That is why the practical change is to evaluate supported pipeline parallel scheduling and microbatching to overlap stages where suitable. This directly addresses the reported issue at the Northbridge fraud analytics department.
Incorrect Answers
That statement concerns tensor model parallelism; here the reported facts point to a different issue: naive stage-by-stage execution can leave most devices waiting instead of sharing useful work. For the Northbridge fraud analytics department, the priority is to evaluate supported pipeline parallel scheduling and microbatching to overlap stages where suitable.
PUE describes overhead for a data center and not the useful compute performed per GPU watt. This can occur in other projects, but it is not the primary explanation at the Northbridge fraud analytics department.
This explanation belongs to physical security zones. The immediate weakness in the question is that naive stage-by-stage execution can leave most devices waiting instead of sharing useful work. For the Northbridge fraud analytics department, the priority is to evaluate supported pipeline parallel scheduling and microbatching to overlap stages where suitable.