NVIDIA® H200 NVL
The NVIDIA H200 NVL brings the power of HBM3e memory to a PCIe NVLink form factor, enabling high-performance AI workloads in standard server configurations.
Availability
Available on Rackrr through our marketplace providers. Check the platform for real-time pricing and availability.
Specifications
| Component | Details |
|---|---|
| GPU Model | NVIDIA® H200 NVL |
| Architecture | NVIDIA Hopper |
| CUDA Cores | 16,896 |
| Tensor Cores | 528 (4th Gen) |
| VRAM | 141 GB |
| VRAM Type | HBM3e |
| Memory Bandwidth | 4.8 TB/s |
| TDP (Thermal Design Power) | 600W |
| Form Factor | PCIe NVL |
| Interconnect | NVLink Bridge (600 GB/s) |
| FP8 Performance | 3,958 TFLOPS |
| FP16 Performance | 1,979 TFLOPS |
| Deep Learning Frameworks | PyTorch, TensorFlow, JAX |
Use Cases
- AI inference at scale
- Generative AI workloads
- Retrieval-augmented generation (RAG)
- High-performance computing (HPC)