Quick Specs
- Model: H100
- GPU Memory: 96GB
- Memory Bandwidth: 3.9TB/s
- Max Power Consumption: 350-400W (configurable)
- Graphic Bus / System Interface: PCIe Gen5x16/ NVIDIA NVLink: 600GB/s
- Interconnect Bandwidth: 128 GB/sec (PCIe 5.0)
- Slot Width: DW
- NVIDIA AI Enterprise: Included
Supercharge Large Language Model Inference With H100 NVL
For LLMs up to 70 billion parameters (Llama 2 70B), the PCIe-based NVIDIA H100 NVL with NVLink bridge utilizes Transformer Engine, NVLink, and 188GB HBM3 memory to provide optimum performance and easy scaling across any data center, bringing LLMs to the mainstream. Servers equipped with H100 NVL GPUs increase Llama 2 70B performance up to 5X over NVIDIA A100 systems while maintaining low latency in power-constrained data center environments.
Compatible With:
- Dell R760
- Dell R760xa
- Dell R7715
(Click to View)