Qwen3 4B
The smallest Qwen3 worth running. It has the same thinking mode as its bigger siblings, so it can reason step by step when you ask, and it fits on almost anything, including laptops with no graphics card.
ollama run qwen3:4bNeeds about 4 GB of graphics memory, or unified memory on a Mac. First time? Install Ollama, then paste that into a terminal.
Download2.5 GB
Memory to runAbout 4 GB
Read per token2.5 GB
LicenseApache 2.0
Context32K tokens
ReleasedApril 2025
Good for
- Fast chat on old or low-memory machines
- Summarizing and rewriting short text
- Classifying and extracting data in scripts
- A draft model for speculative decoding
Not the best pick for
- Long, careful coding work
- Facts it has to remember rather than look up
146 GPUs and Macs
What runs Qwen3 4B
Estimated speed on each card at the smallest memory size that fits it, from memory bandwidth. As a dense model it reads all its weights for every token, so memory bandwidth sets the speed.
Runs great 137 cards
- H200141 GB · ~1060 tok/s
- H10080 GB · ~740 tok/s
- RTX 509032 GB · ~390 tok/s
- RTX Pro 6000 Blackwell96 GB · ~390 tok/s
- A10040 GB · ~340 tok/s
- RTX Pro 5000 Blackwell48 GB · ~300 tok/s
- Instinct MI10032 GB · ~270 tok/s
- Instinct MI5016 GB · ~230 tok/s
- RTX 3090 Ti24 GB · ~220 tok/s
- RTX 409024 GB · ~220 tok/s
- RTX 508016 GB · ~210 tok/s
- RTX 6000 Ada48 GB · ~210 tok/s
- RX 7900 XTX24 GB · ~210 tok/s
- RTX 309024 GB · ~210 tok/s
- A3024 GB · ~210 tok/s
- RTX 3080 Ti12 GB · ~200 tok/s
- Tesla V10016 GB · ~200 tok/s
- RTX 5070 Ti16 GB · ~200 tok/s
- RTX 5080 Laptop16 GB · ~200 tok/s
- RTX 5090 Laptop24 GB · ~200 tok/s
- RTX Pro 4500 Blackwell32 GB · ~200 tok/s
- L40S48 GB · ~190 tok/s
- Radeon Pro W790048 GB · ~190 tok/s
- Apple M3 Ultra96 GB · ~180 tok/s
- RX 7900 XT20 GB · ~180 tok/s
- Apple M1 Ultra64 GB · ~180 tok/s
- Apple M2 Ultra64 GB · ~180 tok/s
- RTX A500024 GB · ~170 tok/s
- RTX A550024 GB · ~170 tok/s
- RTX A600048 GB · ~170 tok/s
- RTX 308010 GB · ~170 tok/s
- RTX 4080 Super16 GB · ~160 tok/s
- Tesla P10012 GB · ~160 tok/s
- RTX 408016 GB · ~160 tok/s
- A4048 GB · ~150 tok/s
- RTX 4070 Ti Super16 GB · ~150 tok/s
- RTX 507012 GB · ~150 tok/s
- RTX 5070 Ti Laptop12 GB · ~150 tok/s
- Titan RTX24 GB · ~150 tok/s
- Quadro RTX 600024 GB · ~150 tok/s
- Quadro RTX 800048 GB · ~150 tok/s
- RTX Pro 4000 Blackwell24 GB · ~150 tok/s
- Titan V12 GB · ~140 tok/s
- RTX A450020 GB · ~140 tok/s
- RX 907016 GB · ~140 tok/s
- RX 9070 XT16 GB · ~140 tok/s
- Radeon AI Pro R970032 GB · ~140 tok/s
- RX 7800 XT16 GB · ~140 tok/s
- RTX 2080 Ti11 GB · ~140 tok/s
- RTX 3070 Ti8 GB · ~130 tok/s
- A1024 GB · ~130 tok/s
- RTX 4090 Laptop16 GB · ~130 tok/s
- RTX 5000 Ada32 GB · ~130 tok/s
- RX 6950 XT16 GB · ~130 tok/s
- RX 7900 GRE16 GB · ~130 tok/s
- Radeon Pro W780032 GB · ~130 tok/s
- Arc A7708 GB · ~120 tok/s
- Apple M4 Max36 GB · ~120 tok/s
- RTX 3080 Ti Laptop16 GB · ~110 tok/s
- RX 680016 GB · ~110 tok/s
- RX 6800 XT16 GB · ~110 tok/s
- RX 6900 XT16 GB · ~110 tok/s
- Radeon Pro W680032 GB · ~110 tok/s
- Arc A7508 GB · ~110 tok/s
- RTX 407012 GB · ~110 tok/s
- RTX 4070 Super12 GB · ~110 tok/s
- RTX 4070 Ti12 GB · ~110 tok/s
- RTX 2080 Super8 GB · ~110 tok/s
- GTX 1080 Ti11 GB · ~110 tok/s
- Apple M5 Max36 GB · ~100 tok/s
- Arc B58012 GB · ~100 tok/s
- Arc Pro B6024 GB · ~100 tok/s
- RTX 2060 Super8 GB · ~99 tok/s
- RTX 20708 GB · ~99 tok/s
- RTX 2070 Super8 GB · ~99 tok/s
- RTX 20808 GB · ~99 tok/s
- RTX 3060 Ti8 GB · ~99 tok/s
- RTX 30708 GB · ~99 tok/s
- RTX 50608 GB · ~99 tok/s
- RTX 5060 Ti8 GB · ~99 tok/s
- RTX 3070 Laptop8 GB · ~99 tok/s
- RTX 3070 Ti Laptop8 GB · ~99 tok/s
- RTX 3080 Laptop8 GB · ~99 tok/s
- Quadro RTX 500016 GB · ~99 tok/s
- RTX A400016 GB · ~99 tok/s
- RTX 4080 Laptop12 GB · ~95 tok/s
- RTX 4500 Ada24 GB · ~95 tok/s
- RX 7700 XT12 GB · ~95 tok/s
- Quadro RTX 40008 GB · ~92 tok/s
- Apple M1 Max32 GB · ~88 tok/s
- Apple M2 Max32 GB · ~88 tok/s
- Apple M3 Max36 GB · ~88 tok/s
- RTX 5070 Laptop8 GB · ~84 tok/s
- RX 6700 XT12 GB · ~84 tok/s
- Arc B57010 GB · ~84 tok/s
- RTX 30608 GB · ~79 tok/s
- RTX 4000 Ada20 GB · ~79 tok/s
- Tesla P4024 GB · ~76 tok/s
- GTX 980 Ti6 GB · ~74 tok/s
- GTX 1660 Super6 GB · ~74 tok/s
- RTX 20606 GB · ~74 tok/s
- RTX 3060 Laptop6 GB · ~74 tok/s
- GTX 10808 GB · ~70 tok/s
- Tesla T416 GB · ~70 tok/s
- RX 9060 XT8 GB · ~70 tok/s
- Apple M5 Pro24 GB · ~68 tok/s
- L424 GB · ~66 tok/s
- GTX 1660 Ti6 GB · ~63 tok/s
- RTX 4060 Ti8 GB · ~63 tok/s
- RTX A20006 GB · ~63 tok/s
- Tesla M4012 GB · ~63 tok/s
- RX 76008 GB · ~63 tok/s
- RX 7600 XT16 GB · ~63 tok/s
- Apple M4 Pro24 GB · ~60 tok/s
- NVIDIA DGX Spark128 GB · ~60 tok/s
- RTX 40608 GB · ~60 tok/s
- GTX 10708 GB · ~56 tok/s
- GTX 1070 Ti8 GB · ~56 tok/s
- RTX 4060 Laptop8 GB · ~56 tok/s
- RTX 4070 Laptop8 GB · ~56 tok/s
- RX 6600 XT8 GB · ~56 tok/s
- Ryzen AI Max+ 395 (Radeon 8060S)64 GB · ~56 tok/s
- Ryzen AI Max 390 (Radeon 8050S)32 GB · ~56 tok/s
- GTX 9704 GB · ~49 tok/s
- GTX 9804 GB · ~49 tok/s
- RTX 30506 GB · ~49 tok/s
- RTX 2000 Ada16 GB · ~49 tok/s
- RX 66008 GB · ~49 tok/s
- Jetson AGX Orin32 GB · ~45 tok/s
- Apple M1 Pro16 GB · ~44 tok/s
- Apple M2 Pro16 GB · ~44 tok/s
- GTX 10606 GB · ~42 tok/s
- GTX 16606 GB · ~42 tok/s
- RTX 3050 Laptop4 GB · ~42 tok/s
- RTX 4050 Laptop6 GB · ~42 tok/s
- Apple M516 GB · ~34 tok/s
- Apple M3 Pro18 GB · ~33 tok/s
Usable 9 cards
Cheapest build from our list that runs it well: The computer you already have, from $0 used, at about 22 tok/s. See the builds.
Learn
Read more about Qwen3 4B
- Batch jobs with a local model: process a folder of files with OllamaRun a local model over hundreds or thousands of files with a short Python script and Ollama's API. Summarize, tag or extract, with no per-token bill.
- Build a local voice assistant: Whisper, a local LLM and text-to-speechHow a private voice assistant works on your own hardware, which parts to use for speech, thinking and speaking, and how to make it answer fast.
- How to run AI locally: your first model in ten minutesInstall Ollama, run one command, and chat with an open model on the computer you already own. No account, no cloud, no monthly bill.
- Local AI for families and kids: private, but not automatically safeWhat running AI at home means for a family. The real privacy benefits, the safety filters you lose, which models to use, and how to set it up for children.
- Local AI for Home Assistant: a private voice assistant with OllamaConnect Home Assistant to a model running on your own hardware with the Ollama integration. What hardware you need, which model to pick, and how to set it up.
- Local AI for Obsidian: chat with your notes privatelyHow to connect Obsidian to a model running on your own machine with Ollama, which plugins and models to use, and how to keep your vault private.
- Local text to speech: natural voices without the cloudHow local text to speech works, the kinds of models and tools available, what hardware they need, and how to pair one with a local chat model.
- Mini PCs and AMD Strix Halo for local AI: unified memory on x86Can a mini PC run local LLMs? What ordinary mini PCs manage, why AMD's Strix Halo chips with up to 128 GB of shared memory are different, and the trade-offs.
- Mining cards for AI: do NVIDIA CMP cards run local LLMs?Can ex-mining NVIDIA CMP cards run local AI? What works, the limits to check before buying, and what we learned running them in our 90-GPU rack.
- Ollama commands cheat sheet: every command you'll actually useThe Ollama commands for running, downloading, listing, stopping and deleting models, plus the in-chat slash commands and the settings worth knowing.
- Ollama on a Mac: setup for Apple silicon, step by stepInstall Ollama on an M-series Mac, pick a model that fits your memory, check it's using the GPU, and change the settings that matter.
- Run AI in your browser with WebGPU: local models, no installHow WebLLM and WebGPU run language models and image generation on your own GPU inside a browser tab, what works, and where it falls short of Ollama.
- Run an LLM on CPU only: local AI on a laptop without a GPUWhich models run on a laptop with no graphics card, how fast to expect them, and the settings that make CPU-only local AI usable.
- Speculative decoding: make local LLMs faster with a draft modelHow speculative decoding uses a small draft model to speed up a big one with no quality loss, when it helps, and how to turn it on in llama.cpp.
- Structured output with Ollama: get reliable JSON from a local modelUse Ollama's format parameter to make a local model return valid JSON, or JSON that matches your own schema. Working curl and Python examples, plus tips.
- The best local LLM for 12 GB of VRAM (RTX 3060, 4070, B580)What to run on a 12 GB graphics card like the RTX 3060, 4070 or Arc B580. Picks for smarts, images and speed, with estimated speeds for each card.
- The best local LLM for 8 GB of VRAMWhich open models run well on an 8 GB graphics card like the RTX 4060, 3070 or RX 7600, how fast they go, and what to do when you outgrow it.
- The best local LLM for a 16 GB Mac (MacBook Air, Mac mini)What runs well on a Mac with 16 GB of unified memory, how fast each M-series chip is, and how to keep the model from slowing your Mac down.
- The best small local model for scripts, classification and JSONWhich small open model to use when a script calls it thousands of times to classify text, extract fields or return JSON, and how to get reliable structured output.
Compare
Other models
- Qwen3 8BAbout 7 GB · A solid all-rounder for chat and writing
- Gemma 3 12BAbout 10 GB · Reads images as well as text
- Qwen3 14BAbout 11 GB · Noticeably smarter at reasoning and code
- gpt-oss 20BAbout 16 GB · OpenAI's open model. Fast, strong reasoning
- Gemma 3 27BAbout 19 GB · Google's best open model for its size
- Qwen3 30B-A3BAbout 21 GB · 30B smarts at small-model speed
- Qwen3 32BAbout 22 GB · Strong coding and long answers
- Llama 3.3 70BAbout 45 GB · Close to the big cloud models
- gpt-oss 120BAbout 67 GB · OpenAI's largest open model
- Qwen3 235B-A22BAbout 144 GB · Alibaba's flagship open model, for multi-GPU rigs
- DeepSeek R1 671BAbout 406 GB · The full DeepSeek R1, for the biggest rigs