NVIDIA A100 SXM4 40 GB vs NVIDIA RTX A400
GPU · Specs Compare
Graphics Card
Release Date
May 2020
Apr 2024
Generation
Tesla Ampere
Quadro Ampere(Ax000)
Type
AI GPU
Desktop
Bus Interface
PCIe 4.0 x16
PCIe 4.0 x8
Clock Speeds
Base Clock
1095 MHz
1417 MHz
Boost Clock
1410 MHz
1762 MHz
Memory Clock
1215 MHz
1500 MHz
Memory
Memory Size
40GB
4GB
Memory Type
HBM2e
GDDR6
Memory Bus
5120bit
64bit
Bandwidth
1555GB/s
96.00GB/s
Render Config
SM Count
108
6
Shading Units
6912
768
TMUs
432
24
ROPs
160
16
Tensor Cores
432
24
L1 Cache
192 KB (per SM)
128 KB (per SM)
L2 Cache
40 MB
2 MB
RT Cores
—
6
Theoretical Performance
Pixel Rate
225.6 GPixel/s
28.19 GPixel/s
Texture Rate
609.1 GTexel/s
42.29 GTexel/s
FP16 (half)
77.97 TFLOPS
2.706 TFLOPS
FP32 (float)
19.49 TFLOPS
2.706 TFLOPS
FP64 (double)
9.746 TFLOPS
42.29 GFLOPS
Graphics Processor
GPU Name
GA100
GA107
Architecture
Ampere
Ampere
Foundry
TSMC
Samsung
Process Size
7 nm
8 nm
Transistors
54.2 billion
8.7 billion
Die Size
826 mm²
200 mm²
Board Design
TDP
400W
50W
Suggested PSU
800 W
250 W
Outputs
No outputs
4x mini-DisplayPort 1.4a
Power Connectors
None
None
Graphics Features
DirectX
N/A
12 Ultimate (12_2)
OpenGL
N/A
4.6
OpenCL
3.0
3.0
Vulkan
N/A
1.3
CUDA
8.0
8.6
Shader Model
N/A
6.8
Benchmark
Blender
2,186
—
▲ Specs Compare
Data sourced from official specifications and benchmark tests.