What is the biggest model the H100 can run?

gpt-oss 120B, which needs about 67 GB, on the 80 GB version at about 400 tok/s.

What is the biggest model the RTX Pro 6000 Blackwell can run?

gpt-oss 120B, which needs about 67 GB, on the 96 GB version at about 220 tok/s.

H100 vs RTX Pro 6000 Blackwell for local AI

Q: Which is better for local AI, the H100 or the RTX Pro 6000 Blackwell?

The H100, for speed. They fit the same models. Both fit the same models we track, up to gpt-oss 120B. The H100 generates about 87% faster on any model both can run, because it has 3350 GB/s of memory bandwidth to the RTX Pro 6000 Blackwell's 1792 GB/s.

Both fit the same models we track, up to gpt-oss 120B. The H100 generates about 87% faster on any model both can run, because it has 3350 GB/s of memory bandwidth to the RTX Pro 6000 Blackwell's 1792 GB/s.

The numbers that matter

Memory and bandwidth

Memory decides which models fit. Bandwidth decides how fast they generate, because every token reads the model's active weights once.

	H100	RTX Pro 6000 Blackwell
Memory	80 GB VRAM	96 GB VRAM
Bandwidth	3350 GB/s	1792 GB/s
Biggest model that fits	gpt-oss 120B	gpt-oss 120B
Best everyday pick	gpt-oss 120B, ~400 tok/s	gpt-oss 120B, ~220 tok/s

Model by model

Every model, side by side

Estimated generation speed at the largest memory size each was sold in (80 GB and 96 GB).

Model	H100	RTX Pro 6000 Blackwell
Qwen3 4B About 4 GB	~740 tok/s Runs great	~390 tok/s Runs great
Qwen3 8B About 7 GB	~350 tok/s Runs great	~190 tok/s Runs great
Gemma 3 12B About 10 GB	~230 tok/s Runs great	~120 tok/s Runs great
Qwen3 14B About 11 GB	~200 tok/s Runs great	~110 tok/s Runs great
gpt-oss 20B About 16 GB	~590 tok/s Runs great	~310 tok/s Runs great
Gemma 3 27B About 19 GB	~110 tok/s Runs great	~58 tok/s Runs great
Qwen3 30B-A3B About 21 GB	~590 tok/s Runs great	~310 tok/s Runs great
Qwen3 32B About 22 GB	~92 tok/s Runs great	~49 tok/s Runs great
Llama 3.3 70B About 45 GB	~43 tok/s Runs great	~23 tok/s Usable
gpt-oss 120B About 67 GB	~400 tok/s Runs great	~220 tok/s Runs great
Qwen3 235B-A22B About 144 GB	Needs 144 GB	Needs 144 GB
DeepSeek R1 671B About 406 GB	Needs 406 GB	Needs 406 GB

Which should you get?

The H100, for speed. They fit the same models. Price matters as much as either number: check used prices on the builds page, where every parts list has a measured or estimated speed.

How we estimate

Both columns use the same formula: memory bandwidth divided by the weights read per token, calibrated on our own rack, with Ollama's default 4-bit sizes. Real results are usually within about a third. Measured either one? Send us the number.

Compare

Other matchups

Every comparison