Skip to main content

NVIDIA® H100 PCIe NVL

Location

Pricing

160 cards available

DurationCostUpfront payment
On-demand (hourly)$3.68/GPU-hr0%
Month-to-month$3.51/GPU-hr20%
3 months$3.36/GPU-hr20%
6 months$3.13/GPU-hr20%
1 year$2.86/GPU-hr15%
2 years$2.73/GPU-hr10%
3 years$2.61/GPU-hr10%

Configuration

ComponentDetails
GPU ModelNVIDIA H100
ArchitectureNVIDIA Hopper
MotherboardLenovo
GPUs/Machine8
Compute Units14592
CPU ModelAMD EPYC 9354
CPU Cores32C/64T
Clock Speed1095
VRAM TypeHBM2e
VRAM Size80G
Memory Bandwidth2.04TB/s
RAM768G
RAM typeTruDDR5
Form FactorPCIe
TDP (Thermal Design Power)350W
Processing Power456
InterconnectNVLink
NVLink/InfiniBandNVLink and Infiniband
SXMNo
Cooling SolutionAir Cooled
API SupportAll Supported
Deep Learning Framework SupportAll Supported
CUDA and OpenCL SupportAll Supported
Performance MetricsTBC
CompatibilityAll Supported
Local storage6x7.68T NVMe in MDRAID 10
Type of storageNVMe