NVIDIA DGX H100
The NVIDIA DGX H100 is an 8U eight-GPU system with eight H100 SXM GPUs and 640 GB of total GPU memory, two 56-core Intel Xeon 8480C processors and 2 TB of system memory. It carries eight ConnectX-7 InfiniBand cards for the compute fabric and two ConnectX-7 Ethernet cards for storage, with about 30 TB of NVMe data cache. It succeeded the DGX A100 and is the reference system against which HGX H100 servers from Dell, Supermicro and others are compared.
Also written as: NVIDIA DGX H100 640GB
Specifications
| Brand | NVIDIA |
|---|---|
| Family | DGX |
| Form factor | 8U rackmount |
| Released | 2022 |
| Cpu sockets | 2 |
| Cpu platform | 2x Intel Xeon 8480C, 56 cores each, 2.0/2.9/3.8 GHz (base/all-core turbo/max turbo) |
| Memory max (GB) | 2,048 |
| Memory type | 2 TB using 32 DIMMs |
| Gpu support | 8x NVIDIA H100 SXM GPUs |
| Gpu memory (GB) | 640 |
| Drive bays | 2x 1.92 TB NVMe M.2 (OS, RAID 1) and 8x 3.84 TB NVMe U.2 SED (data cache, RAID 0) |
| Network onboard | 8x ConnectX-7 single-port InfiniBand cards (compute), 2x ConnectX-7 dual-port Ethernet cards (storage and in-band management), 1 GbE BMC port |
| Power supply | 6 power supplies, 3300 W each at 200-240 V |
| Weight kg | 130.45 |
Generations
- Previous generation: NVIDIA DGX A100
Works together
How the NVIDIA DGX H100 connects to servers, storage and the network: 5 ways, with the parts and products on each path.
Fibre Channel SAN
Match the speed: 16Gb and 32Gb FC HBAs, switches and array ports work together, and each generation also runs one or two speeds below its own (a 32Gb port runs at 16Gb and 8Gb).
Switches
Cisco MDS 9124V 1U rack
Cisco MDS 9148V 1RU
Dell Connectrix DS-7730B 2U switch
Brocade G-Series G730 2U
Storage
Dell PowerMax 2500 4U multi-node rack
Dell PowerMax 8500 system bay multi-enclosure
Dell PowerStore 1200T 2U rack
Dell PowerStore 3200T 2U rack
Dell PowerStore 5200T 2U rack
Dell PowerStore 9200T 2U rack
Optics
57-1000262-01 Brocade 16G FC SFP+ ELWL 25 km
57-1000333-01 Brocade 32G FC SFP+ SWL
57-1000487-01 Brocade 16G FC SFP+ SWL
iSCSI and NVMe/TCP over Ethernet
Keep the speed the same at all three points: a 25GbE server, a 25GbE switch port and a 25GbE array port. Mixed speeds work but the slowest link sets the pace.
Switches
NVIDIA Spectrum-3 SN4410 1U fixed switch
NVIDIA Spectrum-2 SN3420 1U fixed switch
NVIDIA Spectrum SN2010 half-width 1U
NVIDIA Spectrum SN2410 1U fixed switch
Direct-attached SAS
12Gb SAS uses Mini-SAS HD (SFF-8644) connectors; older 6Gb gear uses Mini-SAS (SFF-8088). Adapter cables exist, but the link runs at the slower speed.
Storage
Dell PowerVault ME5012 2U rack
Dell PowerVault ME5024 2U rack
Dell PowerVault ME5084 5U rack
Lenovo ThinkSystem DE6400H 2U rack
Lenovo ThinkSystem DE6600H 2U rack
HPE MSA 2060 2U rack
File storage (NFS and SMB)
Front-end ports face the clients; back-end ports (on scale-out systems) connect the nodes to each other and need their own switch pair.
Switches
- NVIDIA Spectrum-3 SN4410 1U fixed switch
- NVIDIA Spectrum-2 SN3420 1U fixed switch
- NVIDIA Spectrum SN2010 half-width 1U
- NVIDIA Spectrum SN2410 1U fixed switch
Storage
NetApp AFF C250 2U rack
NetApp FAS Series FAS2820 2U rack
Pure Storage FlashArray //E 3U rack
Lenovo ThinkSystem DM7100F 4U rack
NetApp AFF A20 2U rack
NetApp AFF A250 2U rack
GPU cluster fabric
InfiniBand adapters and switches must match the generation: HDR is 200Gb, NDR is 400Gb. VPI adapters such as ConnectX-6 and ConnectX-7 can run either InfiniBand or Ethernet.
GPUs
NVIDIA Data Center GPU H100 SXM5 80GB SXM5 module
NVIDIA Data Center GPU H100 PCIe 80GB PCIe 5.0 dual-slot full-height full-length
NVIDIA Data Center GPU A10 PCIe single-slot full-height full-length
NVIDIA Data Center GPU A100 PCIe 80GB PCIe dual-slot full-height full-length
Adapters for the server (check the fit list)
MCX556A-ECAT NVIDIA ConnectX-5 VPI Dual-Port 100Gb/s EDR InfiniBand and 100GbE QSFP28 PCIe 3.0 x16 Adapter
MCX75310AAS-NEAT NVIDIA ConnectX-7 Single-Port 400Gb/s NDR InfiniBand and 400GbE OSFP PCIe 5.0 x16 Adapter
MCX755106AS-HEAT NVIDIA ConnectX-7 Dual-Port 200Gb/s NDR200 InfiniBand and 200GbE QSFP112 PCIe 5.0 x16 Adapter
Switches
NVIDIA Spectrum-4 SN5600 2U fixed switch
NVIDIA Quantum-2 QM9700 1U fixed switch
NVIDIA Quantum-2 QM9790 1U fixed switch
NVIDIA Spectrum-3 SN4700 1U fixed switch
Plan and size it
- Draw this setup in the topology planner mrplanb.com
- Add up rack power and space rack-density.com
- Virtualization storage Ledger: scored storage platforms mrplanb.com
- SAN transport and NVMe over FC for backup mrplanb.com
Check compatibility with NVIDIA
Before you buy, confirm the exact configuration against the vendor's own lists: firmware levels, operating systems, adapters and optics that NVIDIA has tested with the NVIDIA DGX H100.
- Compatibility NVIDIA Qualified System Catalog (certified GPU servers)
- Specifications NVIDIA Networking documentation (adapters, switches, cables)
- Support NVIDIA Enterprise Support
Equivalent models from other brands
Buying a used DGX H100: what to check
Confirm all eight GPUs report as H100 with 80 GB, that all six 3300 W power supplies are fitted, and that the ConnectX-7 cards match the configuration. Ask about the DGX support entitlement and the firmware and DGX OS level, and run the DGX diagnostics under load before paying.
FAQ
How many GPUs and how much GPU memory does the DGX H100 have?
Eight NVIDIA H100 GPUs with 640 GB of total GPU memory.
What CPUs and memory are in the DGX H100?
Two Intel Xeon 8480C processors with 56 cores each and 2 TB of system memory using 32 DIMMs.
What size is the DGX H100?
It is an 8U rackmount system, 14 inches (356 mm) high, up to 35.3 inches (897.1 mm) deep, and up to 287.6 lb (130.45 kg).
Buying or selling DGX H100?
New, refurbished or used. Tell us the quantity and condition and we connect you with a vetted reseller in your region, usually within one working day.
Sources
- NVIDIA DGX H100 System User Guide, Introduction, checked 2026-10-28