Can the Tesla M40 run Qwen3 32B?
Yes, with 24 GB or more. Qwen3 32B needs about 22 GB and the Tesla M40 has 24 GB of VRAM. Expect about 8 tok/s, slow, but it works. The 12 GB version doesn't have room.
ollama run qwen3:32bFirst time? Install Ollama, then paste that into a terminal.
Qwen3 32B needsAbout 22 GB
Tesla M40 has12 or 24 GB VRAM
Bandwidth288 GB/s
Estimated speed~8 tok/s
By memory size
Each Tesla M40 version
- 12 GBToo big
- 24 GBSlow ~8 tok/s
Want it faster?
Speed comes from memory bandwidth: the card reads all 20 GB of active weights for every token. On the Tesla M40, Qwen3 30B-A3B runs at about 50 tok/s if you can trade some quality for speed. Cards that run Qwen3 32B faster:
How we estimate
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.
Keep going