Can the Ryzen AI Max+ 395 (Radeon 8060S) run Llama 3.3 70B?
Yes. Llama 3.3 70B needs about 45 GB and the Ryzen AI Max+ 395 (Radeon 8060S) with 64 GB of unified memory leaves about 48 GB for models. Expect about 3 tok/s, slow, but it works.
ollama run llama3.3:70bFirst time? Install Ollama, then paste that into a terminal.
Each Ryzen AI Max+ 395 (Radeon 8060S) version
- 64 GB (about 48 GB usable)Slow ~3 tok/s
- 96 GB (about 72 GB usable)Slow ~3 tok/s
- 128 GB (about 96 GB usable)Slow ~3 tok/s
Speed comes from memory bandwidth: the card reads all 43 GB of active weights for every token. On the Ryzen AI Max+ 395 (Radeon 8060S), gpt-oss 120B runs at about 31 tok/s if you can trade some quality for speed. Cards that run Llama 3.3 70B faster:
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.