Question 900
At the Dartwood public-sector AI program, an inference workload repeatedly moves tensors between host and GPU while the dashboard displays only GPU compute utilization. What continuing safeguard is most appropriate?
Explanation
Correct Answer
This practice addresses future change, not just today’s incident. The team should profile host-device copies when inference request shapes change because data movement over the host interconnect can dominate end-to-end latency despite idle compute units. This directly addresses the reported issue at the Dartwood public-sector AI program.
Incorrect Answers
This routine applies to per-job telemetry attribution, but it does not maintain the specific correction needed for the problem at the Dartwood public-sector AI program.
That practice helps control a different risk: virtual GPU technology can divide supported physical accelerator capacity among isolated virtual machines. The recurring control here should be to profile host-device copies when inference request shapes change. For the Dartwood public-sector AI program, the priority is to measure host-device transfer rate latency and PCIe-related health where supported.
This maintenance work is reasonable for multi-tenant namespace quotas. The continuing exposure described here is that data movement over the host interconnect can dominate end-to-end latency despite idle compute units. For the Dartwood public-sector AI program, the priority is to measure host-device transfer rate latency and PCIe-related health where supported.