← Every GPUNVIDIA · 24 or 12 GB VRAM · 288 GB/s

What can the Tesla M40 run?

With 24 GB, 8 of 12 popular open models fit. The best pick is Qwen3 30B-A3B at about 50 tok/s, faster than you can read.

ollama run qwen3:30b

First time? Install Ollama, then paste that into a terminal. Is this your machine? Check it on the homepage.

12 GB VRAM

Every model the Tesla M40 12 GB can run

4 of 12 fit. Best pick: Qwen3 8B.

  • Qwen3 4BQuick everyday chat and summaries
    ~63 tok/s
    Runs greatqwen3:4b
  • Qwen3 8BA solid all-rounder for chat and writing
    ~30 tok/s
    Runs greatqwen3:8b
  • Gemma 3 12BReads images as well as text
    ~20 tok/s
    Usablegemma3:12b
  • Qwen3 14BNoticeably smarter at reasoning and code
    ~17 tok/s
    Usableqwen3:14b
  • gpt-oss 20BOpenAI's open model. Fast, strong reasoning
    needs 16 GB
    Too biggpt-oss:20b
  • Gemma 3 27BGoogle's best open model for its size
    needs 19 GB
    Too biggemma3:27b
  • Qwen3 30B-A3B30B smarts at small-model speed
    needs 21 GB
    Too bigqwen3:30b
  • Qwen3 32BStrong coding and long answers
    needs 22 GB
    Too bigqwen3:32b
  • Llama 3.3 70BClose to the big cloud models
    needs 45 GB
    Too bigllama3.3:70b
  • gpt-oss 120BOpenAI's largest open model
    needs 67 GB
    Too biggpt-oss:120b
  • Qwen3 235B-A22BAlibaba's flagship open model, for multi-GPU rigs
    needs 144 GB
    Too bigqwen3:235b
  • DeepSeek R1 671BThe full DeepSeek R1, for the biggest rigs
    needs 406 GB
    Too bigdeepseek-r1:671b
24 GB VRAM

Every model the Tesla M40 24 GB can run

8 of 12 fit. Best pick: Qwen3 30B-A3B.

  • Qwen3 4BQuick everyday chat and summaries
    ~63 tok/s
    Runs greatqwen3:4b
  • Qwen3 8BA solid all-rounder for chat and writing
    ~30 tok/s
    Runs greatqwen3:8b
  • Gemma 3 12BReads images as well as text
    ~20 tok/s
    Usablegemma3:12b
  • Qwen3 14BNoticeably smarter at reasoning and code
    ~17 tok/s
    Usableqwen3:14b
  • gpt-oss 20BOpenAI's open model. Fast, strong reasoning
    ~50 tok/s
    Runs greatgpt-oss:20b
  • Gemma 3 27BGoogle's best open model for its size
    ~9 tok/s
    Slowgemma3:27b
  • Qwen3 30B-A3B30B smarts at small-model speed
    ~50 tok/s
    Runs greatqwen3:30b
  • Qwen3 32BStrong coding and long answers
    ~8 tok/s
    Slowqwen3:32b
  • Llama 3.3 70BClose to the big cloud models
    needs 45 GB
    Too bigllama3.3:70b
  • gpt-oss 120BOpenAI's largest open model
    needs 67 GB
    Too biggpt-oss:120b
  • Qwen3 235B-A22BAlibaba's flagship open model, for multi-GPU rigs
    needs 144 GB
    Too bigqwen3:235b
  • DeepSeek R1 671BThe full DeepSeek R1, for the biggest rigs
    needs 406 GB
    Too bigdeepseek-r1:671b
Common questions

Can the Tesla M40 run it?

Can the Tesla M40 run Qwen3 30B-A3B?

Yes, with 24 GB or more. Qwen3 30B-A3B needs about 21 GB and the Tesla M40 has 24 GB of VRAM. Expect about 50 tok/s, faster than you can read. The 12 GB version doesn't have room.

Can the Tesla M40 run Qwen3 32B?

Yes, with 24 GB or more. Qwen3 32B needs about 22 GB and the Tesla M40 has 24 GB of VRAM. Expect about 8 tok/s, slow, but it works. The 12 GB version doesn't have room.

Can the Tesla M40 run Llama 3.3 70B?

No. Llama 3.3 70B needs about 45 GB and the Tesla M40 has at most 24 GB of VRAM. Ollama can still start it by putting part of the model in system RAM, but it runs several times slower. The most capable model it runs well is Qwen3 30B-A3B, at about 50 tok/s.

Measured, not estimated

Real runs on the Tesla M40

Loading measured runs…

How we estimate

Generating a token reads the model's active weights from memory once, so speed is roughly memory bandwidth (288 GB/s) divided by the active weight size, with efficiency calibrated on our own rack. Sizes are Ollama's default 4-bit downloads plus about 1.2 GB for context. Real results are usually within about a third. Measured runs are on the leaderboard.

Want something bigger?

The Ryzen AI Max+ 395 mini PC, 128 GB runs gpt-oss 120B at about 31 tok/s, from $3,400 used.

See the builds

Compare

Similar cards

Every GPU we track

Head to head

The Tesla M40 against its rivals

Every comparison