Can the Jetson AGX Orin run gpt-oss 120B?
No. gpt-oss 120B needs about 67 GB and the Jetson AGX Orin has at most 64 GB of unified memory, of which about 48 GB is usable for models. The most capable model it runs well is Qwen3 30B-A3B, at about 36 tok/s.
gpt-oss 120B needsAbout 67 GB
Jetson AGX Orin has32 or 64 GB unified memory
Bandwidth205 GB/s
Estimated speedDoesn't fit
By memory size
Each Jetson AGX Orin version
- 32 GB (about 24 GB usable)Too big
- 64 GB (about 48 GB usable)Too big
What runs gpt-oss 120B
These cards have the memory for it, nearest to the Jetson AGX Orin first. The cheapest build on our list that runs it well is the Ryzen AI Max+ 395 mini PC, 128 GB, from $3,400 used, at about 31 tok/s.
How we estimate
Speed is roughly memory bandwidth divided by the weights read per token, calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured it yourself? Send us the number.
Keep going