GPU Model | NVIDIA H100 |
Architecture | NVIDIA Hopper |
Motherboard | Lenovo |
GPUs/Machine | 8 |
Compute Units | 14592 |
CPU Model | AMD EPYC 9354 |
CPU Cores | 32C/64T |
Clock Speed | 1095 |
VRAM Type | HBM2e |
VRAM Size | 80G |
Memory Bandwidth | 2.04TB/s |
RAM | 768G |
RAM type | TruDDR5 |
Form Factor | PCIe |
TDP (Thermal Design Power) | 350W |
Processing Power | 456 |
Interconnect | NVLink |
NVLink/InfiniBand | NVLink and Infiniband |
SXM | No |
Cooling Solution | Air Cooled |
API Support | All Supported |
Deep Learning Framework Support | All Supported |
CUDA and OpenCL Support | All Supported |
Performance Metrics | TBC |
Compatibility | All Supported |
Local storage | 6x7.68T NVMe in MDRAID 10 |
Type of storage | NVMe |