Can the L40S run Llama 3.3 70B?
Yes. Llama 3.3 70B needs about 45 GB and the L40S has 48 GB of VRAM. Expect about 11 tok/s, about reading speed.
ollama run llama3.3:70bFirst time? Install Ollama, then paste that into a terminal.
Llama 3.3 70B needsAbout 45 GB
L40S has48 GB VRAM
Bandwidth864 GB/s
Estimated speed~11 tok/s
Want it faster?
Speed comes from memory bandwidth: the card reads all 43 GB of active weights for every token. On the L40S, Qwen3 32B runs at about 24 tok/s if you can trade some quality for speed. Cards that run Llama 3.3 70B faster:
How we estimate
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.
Keep going