Colorful iCafe RTX 2060 E-Sports V3 vs NVIDIA H200 SXM 141 GB

Comparison of Colorful iCafe RTX 2060 E-Sports V3 with 6 GB GDDR6 and 1,920 cores vs NVIDIA H200 SXM 141 GB with 141 GB HBM3e and 16,896 cores.

Loading...

Performance Rating

NVIDIA H200 SXM 141 GB outperforms Colorful iCafe RTX 2060 E-Sports V3 by 1,303.75% in the overall GPU ARK performance rating

A100 A100
H200 H200
MI325X MI325X

Colorful iCafe RTX 2060 E-Sports V3

4.8

Colorful iCafe RTX 2060 E-Sports V3

4.8
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

NVIDIA H200 SXM 141 GB

67.4

NVIDIA H200 SXM 141 GB

67.4

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

6 ГБ
🔥 +2,250% 141 ГБ

Memory Type

GDDR6 HBM3e

Memory Bandwidth

336.0 GB/s
🔥 4.89 TB/s

Memory Bus Width

192 бит 6,144 бит

ML Performance

FP16 (Half Precision)

12.9 TFLOPS
🔥 +1,974% 267.6 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

6.451 TFLOPS
🔥 +937% 66.91 TFLOPS

FP64 (Double Precision)

0.2016 TFLOPS
🔥 +16,492% 33.45 TFLOPS

CUDA Cores

1,920
🔥 +780% 16,896

RT Cores

30 No

Architecture & Compatibility

GPU Architecture

Turing Hopper

SM (Streaming Multiprocessor)

30
🔥 +340% 132

PCIe Version

PCIe 3.0 x16 PCIe 5.0 x16

ML Software Support

CUDA Version

7.5
🔥 9.0

Clocks & Performance

Base Clock

1,365
🔥 +10% 1,500

Boost Clock

1,680
🔥 +18% 1,980

Memory Clock

1,750
🔥 1,593

Power Consumption

TDP/TGP

🔥 -77% 160 W
700 W

Recommended PSU

🔥 -59% 450 W
1100 W

Power Connector

1x 8-pin 8-pin EPS

Rendering

Texture Units (TMU)

120
🔥 +340% 528

ROP

30 No

L2 Cache

3 MB
🔥 +1,567% 50 MB

Benchmarks

MLPerf, llama2-70b-99.9 (UNSET)

3 534 tokens/s

MLPerf, llama2-70b-99.9 (fp16)

3 553 tokens/s

MLPerf, llama2-70b-99.9 (fp8)

2 444 tokens/s

MLPerf, llama3.1-405b (fp16)

40.8 tokens/s

MLPerf, llama3.1-405b (fp8)

25.3 tokens/s

MLPerf, llama3.1-8b (fp8)

5 161 tokens/s

MLPerf, deepseek-r1 (fp8)

1 113 tokens/s

MLPerf, mixtral-8x7b (fp8)

7 132 tokens/s

Additional

Slots

Dual-slot
🔥 SXM Module

Release Date

Jan. 7, 2019 Nov. 18, 2024

Display Outputs

1x DVI
1x HDMI 2.0
2x DisplayPort 1.4a
1x USB Type-C

1x DVI
1x HDMI 2.0
1x DisplayPort 1.4a
No outputs

Renting is cheaper than buying