Can the Quadro RTX 4000 run Gemma 3 12B?
No. Gemma 3 12B needs about 10 GB and the Quadro RTX 4000 has at most 8 GB of VRAM. Ollama can still start it by putting part of the model in system RAM, but it runs several times slower. The most capable model it runs well is Qwen3 8B, at about 44 tok/s.
Gemma 3 12B needsAbout 10 GB
Quadro RTX 4000 has8 GB VRAM
Bandwidth416 GB/s
Estimated speedDoesn't fit
What runs Gemma 3 12B
These cards have the memory for it, nearest to the Quadro RTX 4000 first. The cheapest build on our list that runs it well is the Used desktop + RTX 3060 12 GB, from $600 used, at about 24 tok/s.
How we estimate
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.
Keep going