What can the RTX 5090 run?
With 32 GB, 8 of 12 popular open models fit. The best pick is Qwen3 32B at about 49 tok/s, faster than you can read.
ollama run qwen3:32bFirst time? Install Ollama, then paste that into a terminal. Is this your machine? Check it on the homepage.
Every model the RTX 5090 can run
- Qwen3 4BQuick everyday chat and summaries~390 tok/sRuns great
qwen3:4b - Qwen3 8BA solid all-rounder for chat and writing~190 tok/sRuns great
qwen3:8b - Gemma 3 12BReads images as well as text~120 tok/sRuns great
gemma3:12b - Qwen3 14BNoticeably smarter at reasoning and code~110 tok/sRuns great
qwen3:14b - gpt-oss 20BOpenAI's open model. Fast, strong reasoning~310 tok/sRuns great
gpt-oss:20b - Gemma 3 27BGoogle's best open model for its size~58 tok/sRuns great
gemma3:27b - Qwen3 30B-A3B30B smarts at small-model speed~310 tok/sRuns great
qwen3:30b - Qwen3 32BStrong coding and long answers~49 tok/sRuns great
qwen3:32b - Llama 3.3 70BClose to the big cloud modelsneeds 45 GBToo big
llama3.3:70b - gpt-oss 120BOpenAI's largest open modelneeds 67 GBToo big
gpt-oss:120b - Qwen3 235B-A22BAlibaba's flagship open model, for multi-GPU rigsneeds 144 GBToo big
qwen3:235b - DeepSeek R1 671BThe full DeepSeek R1, for the biggest rigsneeds 406 GBToo big
deepseek-r1:671b
Can the RTX 5090 run it?
Can the RTX 5090 run Qwen3 30B-A3B?
Yes. Qwen3 30B-A3B needs about 21 GB and the RTX 5090 has 32 GB of VRAM. Expect about 310 tok/s, faster than you can read.
Can the RTX 5090 run Qwen3 32B?
Yes. Qwen3 32B needs about 22 GB and the RTX 5090 has 32 GB of VRAM. Expect about 49 tok/s, faster than you can read.
Can the RTX 5090 run Llama 3.3 70B?
No. Llama 3.3 70B needs about 45 GB and the RTX 5090 has at most 32 GB of VRAM. Ollama can still start it by putting part of the model in system RAM, but it runs several times slower. The most capable model it runs well is Qwen3 32B, at about 49 tok/s.
Generating a token reads the model's active weights from memory once, so speed is roughly memory bandwidth (1792 GB/s) divided by the active weight size, with efficiency calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured one yourself? Send us the number.
The Ryzen AI Max+ 395 mini PC, 128 GB runs gpt-oss 120B at about 31 tok/s, from $3,400 used.
Similar cards
The RTX 5090 against its rivals
- RTX 5090 vs RTX 409024 GB · 1008 GB/s
- RTX 5090 vs RTX 309024 GB · 936 GB/s
- RTX 5090 vs RTX Pro 6000 Blackwell96 GB · 1792 GB/s
- RTX 5090 vs Apple M3 Ultra96 / 256 / 512 GB · 819 GB/s
- RTX 5090 vs Tesla V10016 / 32 GB · 900 GB/s
- RTX 5090 vs RTX Pro 4500 Blackwell32 GB · 896 GB/s
- RTX 5090 vs Instinct MI10032 GB · 1229 GB/s