HPE
Dell
EqualLogic
- All EqualLogic PS Series
- EqualLogic PS6610 Series
- EqualLogic PS6510 Series
- EqualLogic PS6500 Series
- EqualLogic PS6210 Series
- EqualLogic PS6110 Series
- EqualLogic PS6100 Series
- EqualLogic PS6010 Series
- EqualLogic PS6000 Series
- EqualLogic PS5000/PS5500 Series
- EqualLogic PS4210 Series
- EqualLogic PS-M4110 Series
- EqualLogic PS4110 Series
- EqualLogic PS4100 Series
- EqualLogic PS4000 Series
- EqualLogic PS3000 Series
Specs
Quick Specs
- Model: H100
- GPU Memory: 96GB
- Memory Bandwidth: 3.9TB/s
- Max Power Consumption: 350-400W (configurable)
- Graphic Bus / System Interface: PCIe Gen5x16/ NVIDIA NVLink: 600GB/s
- Interconnect Bandwidth: 128 GB/sec (PCIe 5.0)
- Slot Width: DW
- NVIDIA AI Enterprise: Included
Supercharge Large Language Model Inference With H100 NVL
For LLMs up to 70 billion parameters (Llama 2 70B), the PCIe-based NVIDIA H100 NVL with NVLink bridge utilizes Transformer Engine, NVLink, and 188GB HBM3 memory to provide optimum performance and easy scaling across any data center, bringing LLMs to the mainstream. Servers equipped with H100 NVL GPUs increase Llama 2 70B performance up to 5X over NVIDIA A100 systems while maintaining low latency in power-constrained data center environments.
Compatible With:
- Dell R760
- Dell R760xa
(Click to View)
Base Standard Capabilities
| H100 SXM | H100 NVL | |
|---|---|---|
| FP64 | 34 teraFLOPS | 30 teraFLOPs |
| FP64 Tensor Core | 67 teraFLOPS | 60 teraFLOPs |
| FP32 | 67 teraFLOPS | 60 teraFLOPs |
| TF32 Tensor Core* | 989 teraFLOPS | 835 teraFLOPs |
| BFLOAT16 Tensor Core* | 1,979 teraFLOPS | 1,671 teraFLOPS |
| FP16 Tensor Core* | 1,979 teraFLOPS | 1,671 teraFLOPS |
| FP8 Tensor Core* | 3,958 teraFLOPS | 3,341 teraFLOPS |
| INT8 Tensor Core* | 3,958 TOPS | 3,341 TOPS |
| GPU Memory | 80GB | 94GB |
| GPU Memory Bandwidth | 3.35TB/s | 3.9TB/s |
| Decoders | 7 NVDEC 7 JPEG | 7 NVDEC 7 JPEG |
| Max Thermal Design Power (TDP) | Up to 700W (configurable) | 350-400W (configurable) |
| Multi-Instance GPUs | Up to 7 MIGS @ 10GB each | Up to 7 MIGS @ 12GB each |
| Form Factor | SXM | PCIe dual-slot air-cooled |
| Interconnect | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s | NVIDIA NVLink: 600GB/s PCIe Gen5: 128GB/s |
| Server Options | NVIDIA HGX H100 Partner and NVIDIA- Certified Systems™ with 4 or 8 GPUs NVIDIA DGX H100 with 8 GPUs | Partner and NVIDIA-Certified Systems with 1–8 GPUs |
| NVIDIA AI Enterprise | Add-on | Included |