NVIDIA L40

NVIDIA L40 — 48 Гб GDDR6, 18,176 ядер, GPI 36.3

Loading...

Performance Rating

The L40 is a professional graphics card by NVIDIA, launched on October 13th, 2022. Built on the 5 nm process, and based on the AD102 graphics processor, in its AD102-895-A1 variant, the card supports DirectX 12 Ultimate. The AD102 graphics processor is a large chip with a die area of 609 mm² and 76,300 million transistors. Unlike the fully unlocked TITAN Ada, which uses the same GPU but has all 18432 shaders enabled, NVIDIA has disabled some shading units on the L40 to reach the product's target shader count. It features 18176 shading units, 568 texture mapping units, and 192 ROPs. Also included are 568 tensor cores which help improve the speed of machine learning applications. The card also has 142 raytracing acceleration cores. NVIDIA has paired 48 GB GDDR6 memory with the L40, which are connected using a 384-bit memory interface. The GPU is operating at a frequency of 735 MHz, which can be boosted up to 2490 MHz, memory is running at 2250 MHz (18 Gbps effective).

A100 A100
H200 H200
MI325X MI325X

NVIDIA L40

36.3

NVIDIA L40

36.3

Memory

Memory Size

48 ГБ

Memory Type

Memory Bandwidth

864.0 GB/s

Memory Bus Width

384 бит

ML Performance

FP16 (Half Precision)

90.52 TFLOPS
998.4 TFLOPS
(Intel UHD Graphics 730)

BF16 (Brain Float)

No TFLOPS
311.84 TFLOPS
(NVIDIA A800 SXM4 80 GB)

TF32 (TensorFloat)

Compute Power

FP32 (Single Precision)

90.52 TFLOPS

FP64 (Double Precision)

No TFLOPS
1,204,000.0 TFLOPS
(AMD Radeon RX 7900M)

CUDA Cores

Architecture & Compatibility

GPU Architecture

Ada Lovelace

SM (Streaming Multiprocessor)

PCIe Version

PCIe 4.0 x16

ML Software Support

CUDA Version

Clocks & Performance

Base Clock

Boost Clock

Memory Clock

Power Consumption

TDP/TGP

300 W
unknown
(NVIDIA CMP 70HX)

Recommended PSU

Power Connector

1x 16-pin

Rendering

Texture Units (TMU)

NVENC / NVDEC

NVENC Generation

8th Gen

NVENC Chips

1

Max Encoding Sessions

Unrestricted

Encoding (NVENC)

H.264: H.265: AV1:

NVDEC Generation

5th Gen

NVDEC Chips

1

Decoding (NVDEC)

H.264: H.265: AV1: VP9:

Additional

Slots

Dual-slot
SXM Module
(NVIDIA H200 SXM 141 GB)

Release Date

Oct. 13, 2022

Display Outputs

4x DisplayPort 1.4a
4x mini-DisplayPort 2.0
4x HDMI 2.1
(SPARKLE Arc A310 OmniView)

Renting is cheaper than buying