NVIDIA Jetson AGX Orin 64 GB vs NVIDIA A40 PCIe

GPU · Specs Compare

Products
GPU NVIDIA Jetson AGX Orin 64 GB NVIDIA · 2023-03
GPU NVIDIA A40 PCIe NVIDIA · 2020-10
Graphics Card
Release Date
Mar 2023
Oct 2020
Generation
Tegra
Tesla
Type
Professional
Desktop
Bus Interface
PCIe 4.0 x4
PCIe 4.0 x16
Clock Speeds
Memory Clock
800 MHz
1812 MHz
Base Clock
—
1305 MHz
Boost Clock
—
1740 MHz
Memory
Memory Size
64GB
48GB
Memory Type
LPDDR5
GDDR6
Memory Bus
256bit
384bit
Bandwidth
204.8GB/s
695.8GB/s
Render Config
SM Count
16
84
Shading Units
2048
10752
TMUs
64
336
ROPs
32
112
Tensor Cores
64
336
L1 Cache
128 KB (per SM)
128 KB (per SM)
L2 Cache
6 MB
6 MB
RT Cores
—
84
Theoretical Performance
Pixel Rate
41.60 GPixel/s
194.9 GPixel/s
Texture Rate
83.20 GTexel/s
584.6 GTexel/s
FP16 (half)
10.65 TFLOPS
37.42 TFLOPS
FP32 (float)
5.325 TFLOPS
37.42 TFLOPS
FP64 (double)
2.662 TFLOPS
584.6 GFLOPS
Graphics Processor
GPU Name
GA10B
GA102
Architecture
Ampere
Ampere
Foundry
Samsung
Samsung
Process Size
8 nm
8 nm
Transistors
Unknown
28.3 billion
Die Size
200 mm²
628 mm²
Board Design
TDP
60W
300W
Outputs
Portable Device Dependent
3x DisplayPort 1.4a
Suggested PSU
—
700 W
Power Connectors
—
8-pin EPS
Graphics Features
DirectX
12 Ultimate (12_2)
12 Ultimate (12_2)
OpenGL
4.6
4.6
OpenCL
3.0
3.0
Vulkan
1.4
1.3
CUDA
8.7
8.6
Shader Model
6.8
6.6
▲ Specs Compare Data sourced from official specifications and benchmark tests.