← Everything the RTX A4000 runsRTX A4000 · gpt-oss 20B

Can the RTX A4000 run gpt-oss 20B?

Yes. gpt-oss 20B needs about 16 GB and the RTX A4000 has 16 GB of VRAM. Expect about 78 tok/s, faster than you can read.

ollama run gpt-oss:20b

First time? Install Ollama, then paste that into a terminal.

gpt-oss 20B needsAbout 16 GB
RTX A4000 has16 GB VRAM
Bandwidth448 GB/s
Estimated speed~78 tok/s
Want it faster?

Speed comes from memory bandwidth: the card reads all 2 GB of active weights for every token. Cards that run gpt-oss 20B faster:

How we estimate

Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.

Keep going

More about the RTX A4000 and gpt-oss 20B