NVIDIA P104-101 vs NVIDIA RTX PRO 6000 Blackwell Server

Comparison of NVIDIA P104-101 with 4 GB GDDR5 and 2,560 cores vs NVIDIA RTX PRO 6000 Blackwell Server with 96 GB GDDR7 and 24,064 cores.

Loading...

Performance Rating

NVIDIA RTX PRO 6000 Blackwell Server outperforms NVIDIA P104-101 by 1,013.76% in the overall GPU ARK performance rating

A100 A100
H200 H200
MI325X MI325X

NVIDIA P104-101

5.2

NVIDIA P104-101

5.2
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

NVIDIA RTX PRO 6000 Blackwell Server

57.5

NVIDIA RTX PRO 6000 Blackwell Server

57.5

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

4 ГБ
🔥 +2,300% 96 ГБ

Memory Type

GDDR5 GDDR7

Memory Bandwidth

256.3 GB/s
🔥 1.79 TB/s

Memory Bus Width

256 бит 512 бит

ML Performance

FP16 (Half Precision)

134.6 TFLOPS
🔥 126.0 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

8.617 TFLOPS
🔥 +1,362% 126.0 TFLOPS

FP64 (Double Precision)

0.2693 TFLOPS
🔥 +631% 1.968 TFLOPS

CUDA Cores

2,560
🔥 +840% 24,064

RT Cores

No
🔥 188

Architecture & Compatibility

GPU Architecture

Pascal Blackwell 2.0

SM (Streaming Multiprocessor)

20
🔥 +840% 188

PCIe Version

PCIe 1.0 x4 PCIe 5.0 x16

ML Software Support

CUDA Version

6.1
🔥 12.0

Clocks & Performance

Base Clock

1,506
🔥 +6% 1,590

Boost Clock

1,683
🔥 +55% 2,617

Memory Clock

2,002
🔥 1,750

Power Consumption

TDP/TGP

unknown 600 W

Recommended PSU

🔥 -80% 200 W
1000 W

Power Connector

1x 8-pin 1x 16-pin

Rendering

Texture Units (TMU)

160
🔥 +370% 752

ROP

No
🔥 188

L2 Cache

2 MB
🔥 +6,300% 128 MB

Benchmarks

MLPerf, llama2-70b-99.9 (fp4)

3 250 tokens/s

MLPerf, llama3.1-8b (fp4)

5 758 tokens/s

Geekbench AI, FP16

53 322 points

Geekbench AI, INT8

28 264 points

Geekbench AI, FP32

37 299 points

MLPerf, mixtral-8x7b (fp8)

3 767 tokens/s

Additional

Slots

Dual-slot Dual-slot

Release Date

Jan. 5, 2018 March 18, 2025

Display Outputs

No outputs
4x DisplayPort 2.1b

Renting is cheaper than buying