NVIDIA DGX H100
A complete, ready-to-run server with 8 H100 chips working together.
GPU memory
640 GB
GPU memory is the "workspace" a graphics card uses to hold an AI model while it runs. If a model is bigger than the available memory, it simply will not fit — like trying to fit a large book on a shelf that's too small. More in the wiki →
8 GPUs × 80 GB each.
Power draw
10,200 W
Watts measure how much electricity something draws while it's running. More powerful hardware needs more electricity and produces more heat that has to be cooled. More in the wiki →
Ideal cooling
Air-cooled server
Cools itself with internal fans but dumps all its heat into the room - the room needs datacenter-grade air conditioning with hot/cold aisle layout. Running flat out, it turns 10,200 W of electricity into heat that has to go somewhere. We stock matching cooling gear →
Price
$375,000
This is a current typical market price, not a fixed list price — real prices move with supply and demand. NVIDIA does not publish a list price for DGX systems. Reported prices span roughly $300,000–$480,000; we use $375,000 as a representative typical figure.
CPU
2x Intel Xeon Platinum 8480C (56 cores each, 112 cores total)
The CPU is the general-purpose "manager" chip. It runs the operating system, moves data around, and hands the heavy AI math off to the GPUs. More in the wiki →
System RAM
2,048 GB
System RAM is fast temporary memory the CPU uses for everyday work. It's separate from GPU memory, which is what actually holds the AI model. More in the wiki →
What this means in everyday terms
Running one of these draws as much power as about 8.5 average homes running around the clock. A full day of running one uses about 2.72 electric-car batteries worth of energy. An average home draws roughly 1,200 watts around the clock. This compares a build's power draw to that baseline. More in the wiki →
NVIDIA DGX H100 is sold to run inside a server or rack — it isn't something you plug into a home PC.
Where these numbers come from
Official NVIDIA DGX H100 user guide (GPU count/memory, CPU, RAM, 10.2kW max power). Price is an estimate range from industry reporting (Exxact, Wikipedia); no single authoritative figure exists.
https://docs.nvidia.com/dgx/dgxh100-user-guide/introduction-to-dgxh100.html