H100 PCIe 96 GB

GPU Code: GH100

96 GB

HBM3

1837 MHz

Boost Clock

700 W

TDP

5 nm

Process
Share on Social Media
Share H100 PCIe 96 GB specifications with others

Technical Specifications

Core Specifications
Architecture: Hopper
Process Size: 5 nm
Base Clock: 1665 MHz
Boost Clock: 1837 MHz
Shader Units: 16896
SMs: 132
Tensor Cores: 528
TMUs: 528
ROPs: 24
Memory & Performance
Memory Size: 96 GB
Memory Type: HBM3
Memory Bandwidth: 3360.0 GB/s
Bus Interface: PCIe 5.0 x16
TDP: 700 W
Suggested PSU: 1100 W
Cache & Die Information
L1 Cache: 250 KB
L2 Cache: 50.0 MB
Die Size: 814 mm²
Transistors: 80.0 billion
Transistor Density: 98.3 million/mm²

API Support

Cuda Compute
9.0 sm_90

Physical Specifications

Board Length: 268 mm
Board Width: 111 mm
Power Connectors: 8-pin EPS

Quick Facts

Release Date: 2023-03-21
Manufacturer: NVIDIA
Generation: Server Hopper(Hxx)

Performance

Pixel Fill Rate 44.1 GPixel/s
Texture Fill Rate 969.9 GTexel/s
FP32 Performance 62.1 TFLOPS

CUDA Toolkit Compatibility

Cuda Compute
9.0 sm_90
Architecture

Hopper

Supported CUDA Toolkits
11.8 12.0 12.1 12.2 12.3 12.4 12.5 12.6 12.7 12.8

Hopper architecture with Transformer Engine support for AI workloads