← Everything the RX 6700 XT runsRX 6700 XT · Gemma 3 12B

Can the RX 6700 XT run Gemma 3 12B?

Yes. Gemma 3 12B needs about 10 GB and the RX 6700 XT has 12 GB of VRAM. Expect about 26 tok/s, about reading speed.

ollama run gemma3:12b

First time? Install Ollama, then paste that into a terminal.

Gemma 3 12B needsAbout 10 GB
RX 6700 XT has12 GB VRAM
Bandwidth384 GB/s
Estimated speed~26 tok/s
Want it faster?

Speed comes from memory bandwidth: the card reads all 8.1 GB of active weights for every token. On the RX 6700 XT, Qwen3 8B runs at about 41 tok/s if you can trade some quality for speed. Cards that run Gemma 3 12B faster:

How we estimate

Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.

Keep going

More about the RX 6700 XT and Gemma 3 12B