Can the RX 6900 XT run Gemma 3 27B?
No. Gemma 3 27B needs about 19 GB and the RX 6900 XT has at most 16 GB of VRAM. Ollama can still start it by putting part of the model in system RAM, but it runs several times slower. The most capable model it runs well is gpt-oss 20B, at about 90 tok/s.
Gemma 3 27B needsAbout 19 GB
RX 6900 XT has16 GB VRAM
Bandwidth512 GB/s
Estimated speedDoesn't fit
What runs Gemma 3 27B
These cards have the memory for it, nearest to the RX 6900 XT first. The cheapest build on our list that runs it well is the Used workstation + 2× Tesla P100, from $750 used, at about 24 tok/s.
How we estimate
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.
Keep going