NVIDIA RTX 4000 SFF Ada Generation vs NVIDIA H100 PCIe 96 GB
GPU · Specs Compare
Graphics Card
Release Date
Nov 2018
Mar 2023
Generation
Radeon Instinct
Tesla Hopper
Type
Professional
AI GPU
Bus Interface
PCIe 4.0 x16
PCIe 5.0 x16
Clock Speeds
Base Clock
1200 MHz
1665 MHz
Boost Clock
1746 MHz
1837 MHz
Memory Clock
1000 MHz
1313 MHz
Memory
Memory Size
16GB
96GB
Memory Type
HBM2
HBM3
Memory Bus
4096bit
5120bit
Bandwidth
1.02TB/s
1681GB/s
Render Config
SM Count
48
132
Compute Units
60
—
Shading Units
3840
16896
TMUs
240
528
ROPs
64
24
Tensor Cores
192
528
RT Cores
48
—
L1 Cache
16 KB (per CU)
256 KB (per SM)
L2 Cache
4 MB
50 MB
Theoretical Performance
Pixel Rate
111.7 GPixel/s
44.09 GPixel/s
Texture Rate
419.0 GTexel/s
969.9 GTexel/s
FP16 (half)
26.82 TFLOPS
248.3 TFLOPS
FP32 (float)
13.41 TFLOPS
62.08 TFLOPS
FP64 (double)
6.705 TFLOPS
31.04 TFLOPS
Graphics Processor
GPU Name
Vega 20
GH100
GPU Variant
Vega 20 GLXT
—
Architecture
GCN 5.1
Hopper
Foundry
TSMC
TSMC
Process Size
7 nm
4 nm
Transistors
13.23 billion
80 billion
Die Size
331 mm²
814 mm²
Board Design
TDP
300W
700W
Suggested PSU
700 W
1100 W
Outputs
1x mini-DisplayPort 1.4a
No outputs
Power Connectors
2x 8-pin
8-pin EPS
Graphics Features
DirectX
12 (12_1)
N/A
OpenGL
4.6
N/A
OpenCL
2.1
3.0
Vulkan
1.3
N/A
CUDA
8.9
9.0
Shader Model
6.7
N/A
▲ Specs Compare
Data sourced from official specifications and benchmark tests.