The MW DeskData center power, space & people
Desk answer

How much power does a GPU rack need?

It depends on the system. Published vendor specs range from about 10 kW for one 8-GPU Hopper server to about 120 kW for a full GB200 NVL72 rack.

NVIDIA lists a DGX H100 or H200 system at about 10.2 kW maximum and a DGX B200 at about 14.3 kW maximum. A GB200 NVL72 rack is listed at about 120 kW and is liquid cooled. Racks holding several 8-GPU servers add up fast.

Try our GPU fit check to estimate kW per rack for a configuration, then compare it with what a facility can support.

Sources

Related terms

Have a question? Ask the Desk →