Quick Specs
The NVIDIA ® T4 GPU accelerates diverse cloud workloads, including high-performance computing, deep learning training and inference, machine learning, data analytics, and graphics. Based on the new NVIDIA Turing ™ architecture and packaged in an energy-efficient 70-watt, small PCIe form factor, T4 is optimized for mainstream computing environments and features multi-precision Turing Tensor Cores and new RT Cores. Combined with accelerated containerized software stacks from NGC, T4 delivers revolutionary performance at scale.
SPECIFICATIONS
- GPU Architecture NVIDIA Turing
- NVIDIA Turing Tensor Cores 320
- NVIDIA CUDA ® Cores 2,560
- Single-Precision 8.1 TFLOPS
- Mixed-Precision (FP16/FP32) 65 TFLOPS
- INT8 130 TOPS
- INT4 260 TOPS
- GPU Memory 16 GB GDDR6 | 300 GB/sec
- ECC Yes
- Interconnect
- Bandwidth 32 GB/sec
- System Interface x16 PCIe Gen3
- Form Factor Low-Profile PCIe
- Thermal Solution Passive
- Compute APIs CUDA, NVIDIA TensorRT ™ , ONNX