NVIDIA® RTX A6000 Ada
Location
Pricing
32 cards available
| Duration | Cost |
|---|---|
| Month-to-month | $1.09/GPU-hr |
| 3 months | $1.04/GPU-hr |
| 6 months | $0.98/GPU-hr |
| 12 months | $0.92/GPU-hr |
| 24 months | $0.87/GPU-hr |
| 36 months | $0.81/GPU-hr |
Configuration
Table 2: Specifications
| Component | Details |
|---|---|
| GPU model | NVIDIA® RTX A6000 Ada |
| Architecture | NVIDIA® Ada Lovelace |
| Motherboard | ASUS or Supermicro |
| GPUs per node | 7 or 8 (depending on InfiniBand presence) |
| CUDA cores | 18,176/GPU |
| CPU model | 2x AMD® EPYC 9374 (P or F) |
| CPU cores | 64 physical, 128 virtual |
| Total VRAM | 48 GB |
| VRAM type | GDDR6 |
| Memory bandwidth | 960 GB/s |
| RAM | 1536 GB |
| RAM type | DDR5 |
| Local storage | 2x 3.84 TB NVMe |
| Type of storage | NVMe |
| Form factor | PCIe |
| TDP (Thermal design power) | 350W |
| Tensor Cores | 568 Tensor Cores, 142 RT Cores |
| Interconnect | NVLink |
| SXM support | No |
Additional Storage Options
400+ TB available in August, pricing on-demand