How much power does a GPU rack need?
A Desk explainer, not a reader-submitted question
It depends on the system. Published vendor specs range from about 10 kW for one 8-GPU Hopper server to about 120 kW for a full GB200 NVL72 rack.
NVIDIA lists a DGX H100 or H200 system at about 10.2 kW maximum and a DGX B200 at about 14.3 kW maximum. A GB200 NVL72 rack is listed at about 120 kW and is liquid cooled. Racks holding several 8-GPU servers add up fast.
Try our GPU fit check to estimate kW per rack for a configuration, then compare it with what a facility can support.