Active Models2,847indexed
Model Rankings165updated
Global Latency11msoptimal
Active Models2,847indexed
Model Rankings165updated
Global Latency11msoptimal

NVIDIA RTX 4090 24GB

NVIDIA Consumer24GB GDDR6X • 1 TB/s • 82.6 TFLOPS FP32
$1,500 - $2,200-4.33%In Stock
TDP
450W
VRAM
24GB GDDR6X
Bandwidth
1.0 TB/s
Compute
82.6 FP32
Released
Oct 2022
Availability
In Stock

Description

The RTX 4090 is NVIDIA's flagship consumer GPU based on the Ada Lovelace architecture. The best GPU for AI/ML enthusiasts and local LLM inference.

Benchmarks

3DMark Time Spy
36,515
LLaMA-2 70B
28 tok/s
Stable Diffusion
12.5 it/s
Blender
12,500