NVIDIA® H200
The NVIDIA H200 Tensor Core GPU supercharges generative AI and HPC workloads with the Hopper architecture and advanced HBM3e memory.
Availability
Available on Rackrr through our marketplace providers. Check the platform for real-time pricing and availability.
Specifications
| Component | Details |
|---|---|
| GPU Model | NVIDIA® H200 SXM |
| Architecture | NVIDIA Hopper |
| CUDA Cores | 16,896 |
| Tensor Cores | 528 (4th Gen) |
| VRAM | 141 GB |
| VRAM Type | HBM3e |
| Memory Bandwidth | 4.8 TB/s |
| TDP (Thermal Design Power) | 700W |
| Form Factor | SXM5 |
| Interconnect | NVLink (900 GB/s) |
| FP8 Performance | 3,958 TFLOPS |
| FP16 Performance | 1,979 TFLOPS |
| Deep Learning Frameworks | PyTorch, TensorFlow, JAX |
Use Cases
- Large language model training and inference
- Generative AI workloads
- High-performance computing (HPC)
- Scientific computing and simulations