Please remove $0 item(s) from cart - or - Request for Quote

Dell 96GB NVIDIA H100 NVL x16 PCI-e 350W Passive DW FH GPU | MM3MP

 
Price: Request a Quote

Brand:  
MPN:  
MM3MP
Type:  
GPU
Condition:  
ECS Refurbished & Tested

Request Quote

Note: Please include as much details and relevant options about the item to help us match your request with an accurate price.


-PLEASE CONTACT FOR CUSTOM CONFIGURATIONS. DISK SHELVES, COMPLETE CONFIGURATIONS & TURN KEY SYSTEMS AVAILABLE.
-SPARE PARTS AVAILABLE FOR EACH MODEL. PLEASE ASK FOR PRICING ON SPARE DISK, CONTROLLERS, POWER SUPPLIES, NICs, HBAs, SFPs, Cables, etc.

Dell 96GB NVIDIA H100 NVL x16 PCI-e 350W Passive DW FH GPU | MM3MP

Supercharge Large Language Model Inference With H100 NVL

For LLMs up to 70 billion parameters (Llama 2 70B), the PCIe-based NVIDIA H100 NVL with NVLink bridge utilizes Transformer Engine, NVLink, and 188GB HBM3 memory to provide optimum performance and easy scaling across any data center, bringing LLMs to the mainstream. Servers equipped with H100 NVL GPUs increase Llama 2 70B performance up to 5X over NVIDIA A100 systems while maintaining low latency in power-constrained data center environments.

  • Model: H100
  • GPU Memory: 96GB
  • Memory Bandwidth: 3.9TB/s
  • Max Power Consumption: 350-400W (configurable)
  • Graphic Bus / System Interface: PCIe Gen5x16/ NVIDIA NVLink: 600GB/s
  • Interconnect Bandwidth: 128 GB/sec (PCIe 5.0)
  • Slot Width: DW
  • NVIDIA AI Enterprise: Included

This Product Is Compatible With The Following Systems:

Product Specs

Base Standard Capabilities

 H100 SXMH100 NVL
FP6434 teraFLOPS30 teraFLOPs
FP64 Tensor Core67 teraFLOPS60 teraFLOPs
FP3267 teraFLOPS60 teraFLOPs
TF32 Tensor Core*989 teraFLOPS835 teraFLOPs
BFLOAT16 Tensor Core*1,979 teraFLOPS1,671 teraFLOPS
FP16 Tensor Core*1,979 teraFLOPS1,671 teraFLOPS
FP8 Tensor Core*3,958 teraFLOPS3,341 teraFLOPS
INT8 Tensor Core*3,958 TOPS3,341 TOPS
GPU Memory80GB94GB
GPU Memory Bandwidth3.35TB/s3.9TB/s
Decoders7 NVDEC
7 JPEG
7 NVDEC
7 JPEG
Max Thermal Design Power (TDP)Up to 700W (configurable)350-400W (configurable)
Multi-Instance GPUsUp to 7 MIGS @ 10GB eachUp to 7 MIGS @ 12GB each
Form FactorSXMPCIe
dual-slot air-cooled
InterconnectNVIDIA NVLink™: 900GB/s
PCIe Gen5: 128GB/s
NVIDIA NVLink: 600GB/s
PCIe Gen5: 128GB/s
Server OptionsNVIDIA HGX H100 Partner and NVIDIA-
Certified Systems with 4 or 8 GPUs
NVIDIA DGX H100 with 8 GPUs
Partner and NVIDIA-Certified Systems with 1–8 GPUs
NVIDIA AI EnterpriseAdd-onIncluded

Shipping Information

Express Computer Systems can ship to virtually any address in the world and provides you with the best shipping rates possible. Cost of shipping varies depending on what service you require, your destination and size of the shipment. Shipping costs will be calculated separately from your order and billed to you post purchase. In the notes section of your order please provide us with your preferred shipping method and we will get back to you.

Custom configured orders ship within 2 business days after all required products are in stock.

Please allow 3 business days for products that are not in stock to arrive to our facility in Irvine, California.

Domestic Shipments
  • Standard Ground
    • Shipping time: 2-7 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 2-10 business days
    • Excludes weekends, holidays or weather delays.
  • 3 Business Days
    • Shipping time: 3 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 3-6 business days
    • Excludes weekends, holidays or weather delays.
  • 2 Business Days
    • Shipping time: 2 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 2-5 business days
    • Excludes weekends, holidays or weather delays.
  • Overnight / Next Business Day
    • Shipping time: 1 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 1-4 business days
    • Excludes weekends, holidays or weather delays.
International Shipments
  • International Economy
    • Shipping time: 4-6 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 5-9 business days
    • Excludes weekends, holidays or weather delays.
  • International Priority
    • Shipping time: 1-3 business days
    • Order processing time: 0-3 business days
    • Delivery time after order is placed: 2-6 business days
    • Excludes weekends, holidays or weather delays.

For more information on shipping view our Shipping Information page or send us a message

ECS Warranty Information

Express Computer Systems (ECS) provides a 1 year parts warranty against defects in material or workmanship that will affect the products functionality. All refurbished items are tested prior to shipping to guarantee up-time upon arrival. If you are having issues with an item we provided please Contact Us and we will do our best to assist you.

What does our ECS warranty cover?
We offer 1 year warranty as standard and additional years can be added to fit your needs. Please reach out to a sales associate via the Contact Us page or live chat for more information on extended coverage options. During the coverage period if your product fails we will offer a Next Business Day replacement. If we are unable to replace the product we will refund its original selling price. Shipping costs and tax are not refundable. Express Computer Systems retains the right to decide whether the goods will be replaced or refunded.

What is not covered by our warranty?
Our warranty does not cover any problem caused by the following conditions:

  1. accidents; misuse; carelessness; electrostatic discharge; shock; temperature or humidity beyond the specifications of the product; improper installation; operation; modification;
  2. any improper use that contravenes the instructions in the user manual;
  3. problems caused by other equipment. Our warranty is void if the product is returned with damaged, removed, counterfeit labels, or any modifications (including any component or external cover removal). Our warranties do not cover data loss or damages to any other equipment. In addition, our warranties do not cover incidental damages, consequential damages, or costs related to data recovery, removal, and installation.

Important notes:

  • Please ask for additional warranty/coverage that you may require in addition to the standard 1 ECS warranty prior to final purchase. Requesting additional warranty after your purchase can be denied.
  • FREE technical support is provided on purchased items via phone, email, or live chat.

About Express Computer Systems

Express Computer Systems is committed to transforming our customers’ IT infrastructure with high quality products at affordable costs. Our sales reps and customer support engineers understand our customers rely heavily on advanced technology to run their business but need to do so without breaking the bank.

We specialize in building custom server configurations, custom storage solutions, networking solutions, and components from top manufacturers including HPE, Dell, Cisco, NetApp, Dell EMC, HPE Nimble and many others.

Subscribe