AFOX GTX 750 4 GB vs AMD Radeon Instinct MI325X

Comparison of AFOX GTX 750 4 GB with 4 GB GDDR5 and 512 cores vs AMD Radeon Instinct MI325X with 288 GB HBM3e and 19,456 cores.

Loading...

Performance Rating

A100 A100
H200 H200
MI325X MI325X

AFOX GTX 750 4 GB

0.0

AFOX GTX 750 4 GB

0.0
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

AMD Radeon Instinct MI325X

100.0

AMD Radeon Instinct MI325X

100.0

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

4 ГБ
🔥 +7,100% 288 ГБ

Memory Type

GDDR5 HBM3e

Memory Bandwidth

81.60 GB/s
🔥 10.3 TB/s

Memory Bus Width

128 бит 8,192 бит

ML Performance

FP16 (Half Precision)

No
🔥 653.7 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

No
🔥 81.72 TFLOPS

FP64 (Double Precision)

0.03472 TFLOPS
🔥 +235,269% 81.72 TFLOPS

CUDA Cores

512
🔥 +3,700% 19,456

RT Cores

No No

Architecture & Compatibility

GPU Architecture

Maxwell CDNA 3.0

SM (Streaming Multiprocessor)

No No

PCIe Version

PCIe 3.0 x16 PCIe 5.0 x16

ML Software Support

CUDA Version

5.0 No

Clocks & Performance

Base Clock

1,020
🔥 1,000

Boost Clock

1,085
🔥 +94% 2,100

Memory Clock

1,275
🔥 +98% 2,525

Power Consumption

TDP/TGP

🔥 -94% 55 W
1000 W

Recommended PSU

🔥 -82% 250 W
1400 W

Power Connector

None None

Rendering

Texture Units (TMU)

32
🔥 +3,700% 1,216

ROP

No No

L2 Cache

2 MB
🔥 +700% 16 MB

Benchmarks

MLPerf, llama2-70b-99.9 (Dummy)

3 596 tokens/s

MLPerf, llama2-70b-99.9 (fp8)

1 946 tokens/s

llama.cpp, llama-2-7b-Q4_0

22.4 tokens/s

MLPerf, mixtral-8x7b (fp8)

6 975 tokens/s

Additional

Slots

Single-slot OAM Module

Release Date

Feb. 18, 2014 Oct. 15, 2024

Display Outputs

2x DVI
1x mini-HDMI 1.4a

1x DVI
1x HDMI 1.4a
1x VGA
No outputs

Renting is cheaper than buying