FitLocally by GPUwerk

Qwen · 0.5B

Can you run Qwen2.5 0.5B Instruct locally?

Qwen2.5 0.5B Instruct is a dense model with 0.5B parameters. At 4-bit or better it runs on 120 of the 120 hardware configurations listed here; the smallest is the RTX 5060 (8 GB). On a 128 GB DGX Spark it runs at Q4_K_M, at roughly 188 tokens per second (our est.).

Data as of 2 November 2026

Fastest machines for Qwen2.5 0.5B Instruct

Every machine that runs it, fastest first. Filter by type; your machine is marked. Compare machines running it side by side

  1. 1RTX 5090Graphics card · 32 GB~611 tok/s ModelFit est.Q4_K_M · 1.8 of 31 GB
  2. 2RTX PRO 6000 BlackwellGraphics card · 96 GB~611 tok/s ModelFit est.Q4_K_M · 1.8 of 95 GB
  3. 3RTX 4090Graphics card · 24 GB~534 tok/s ModelFit est.Q4_K_M · 1.8 of 23 GB
  4. 4RTX 5080Graphics card · 16 GB~533 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  5. 5RTX 5070 TiGraphics card · 16 GB~523 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  6. 62x RTX 5090Graphics card · 64 GB~517 tok/s ModelFit est.Q4_K_M · 1.8 of 62 GB
  7. 72x RTX PRO 6000 BlackwellGraphics card · 192 GB~517 tok/s ModelFit est.Q4_K_M · 1.8 of 190 GB
  8. 8RTX 4080 SUPERGraphics card · 16 GB~486 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  9. 9RTX 4080Graphics card · 16 GB~481 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  10. 10M5 MaxMac · 48–128 GB · 3 variants~478 tok/s ModelFit est.Q4_K_M · 1.8 GB
  11. 11RTX 5070Graphics card · 12 GB~478 tok/s ModelFit est.Q4_K_M · 1.8 of 11.0 GB
  12. 12RTX 4070 Ti SUPERGraphics card · 16 GB~471 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  13. 13RTX 3090 TiGraphics card · 24 GB~470 tok/s ModelFit est.Q4_K_M · 1.8 of 23 GB
  14. 142x RTX 4090Graphics card · 48 GB~461 tok/s ModelFit est.Q4_K_M · 1.8 of 46 GB
  15. 15RTX 3090Graphics card · 24 GB~461 tok/s ModelFit est.Q4_K_M · 1.8 of 23 GB
  16. 16RTX 4070 TiGraphics card · 12 GB~420 tok/s ModelFit est.Q4_K_M · 1.8 of 11.0 GB
  17. 17RTX 4070 SUPERGraphics card · 12 GB~420 tok/s ModelFit est.Q4_K_M · 1.8 of 11.0 GB
  18. 18RTX 4070Graphics card · 12 GB~420 tok/s ModelFit est.Q4_K_M · 1.8 of 11.0 GB
  19. 19M5 Max · 36 GB · 32cMac · 36 GB~419 tok/s ModelFit est.Q4_K_M · 1.8 of 24 GB
  20. 20M5 UltraMac · 96–512 GB · 5 variants~415 tok/s ModelFit est.Q4_K_M · 1.8 GB
  21. 212x RTX 3090 TiGraphics card · 48 GB~412 tok/s ModelFit est.Q4_K_M · 1.8 of 46 GB
  22. 22RTX 5060Graphics card · 8 GB~407 tok/s ModelFit est.Q4_K_M · 1.8 of 7.0 GB
  23. 23RTX 5060 TiGraphics card · 16 GB~407 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  24. 242x RTX 3090Graphics card · 48 GB~405 tok/s ModelFit est.Q4_K_M · 1.8 of 46 GB
  25. 25M4 MaxMac · 48–128 GB · 3 variants~399 tok/s ModelFit est.Q4_K_M · 1.8 GB
  26. 26M5 ProMac · 24–64 GB · 6 variants~381 tok/s ModelFit est.Q4_K_M · 1.8 GB
  27. 27RTX 2070Graphics card · 8 GB~369 tok/s ModelFit est.Q4_K_M · 1.8 of 7.0 GB
  28. 28RTX 3070Graphics card · 8 GB~361 tok/s ModelFit est.Q4_K_M · 1.8 of 7.0 GB
  29. 29RTX 3060 TiGraphics card · 8 GB~361 tok/s ModelFit est.Q4_K_M · 1.8 of 7.0 GB
  30. 30M4 Max · 36 GB · 32cMac · 36 GB~350 tok/s ModelFit est.Q4_K_M · 1.8 of 24 GB
  31. 31M3 MaxMac · 48–128 GB · 3 variants~349 tok/s ModelFit est.Q4_K_M · 1.8 GB
  32. 32RTX 3060Graphics card · 12 GB~325 tok/s ModelFit est.Q4_K_M · 1.8 of 11.0 GB
  33. 33M3 UltraMac · 96–512 GB · 5 variants~324 tok/s ModelFit est.Q4_K_M · 1.8 GB
  34. 34M4 ProMac · 24–64 GB · 6 variants~319 tok/s ModelFit est.Q4_K_M · 1.8 GB
  35. 35RTX 4060 TiGraphics card · 16 GB~318 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  36. 36RTX 4060Graphics card · 8 GB~307 tok/s ModelFit est.Q4_K_M · 1.8 of 7.0 GB
  37. 37M3 MaxMac · 36–96 GB · 2 variants~301 tok/s ModelFit est.Q4_K_M · 1.8 GB
  38. 38M2 MaxMac · 32–96 GB · 5 variants~297 tok/s ModelFit est.Q4_K_M · 1.8 GB
  39. 39Tesla T4Graphics card · 16 GB~293 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  40. 40RX 7900 XTXGraphics card · 24 GB~289 tok/s ModelFit est.Q4_K_M · 1.8 of 23 GB
  41. 41Tesla P100Graphics card · 16 GB~284 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  42. 42RX 7900 XTGraphics card · 20 GB~280 tok/s ModelFit est.Q4_K_M · 1.8 of 19.0 GB
  43. 432x RX 7900 XTXGraphics card · 48 GB~266 tok/s ModelFit est.Q4_K_M · 1.8 of 46 GB
  44. 44M1 MaxMac · 32–64 GB · 4 variants~263 tok/s ModelFit est.Q4_K_M · 1.8 GB
  45. 45M2 UltraMac · 64–192 GB · 7 variants~260 tok/s ModelFit est.Q4_K_M · 1.8 GB
  46. 46RX 9070 XTGraphics card · 16 GB~251 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  47. 47M6Mac · 24–32 GB · 3 variants~250 tok/s ModelFit est.Q4_K_M · 1.8 GB
  48. 48M2 ProMac · 16–32 GB · 2 variants~235 tok/s ModelFit est.Q4_K_M · 1.8 GB
  49. 49M6Mac · 16 GB · 2 variants~232 tok/s ModelFit est.Q4_K_M · 1.8 GB
  50. 50M5Mac · 16–32 GB · 6 variants~231 tok/s ModelFit est.Q4_K_M · 1.8 GB
  51. 51M1 UltraMac · 64–128 GB · 4 variants~228 tok/s ModelFit est.Q4_K_M · 1.8 GB
  52. 52M3 ProMac · 18–36 GB · 2 variants~216 tok/s ModelFit est.Q4_K_M · 1.8 GB
  53. 53M1 ProMac · 16–32 GB · 2 variants~210 tok/s ModelFit est.Q4_K_M · 1.8 GB
  54. 54RX 9060 XTGraphics card · 16 GB~210 tok/s ModelFit est.Q4_K_M · 1.8 of 15.0 GB
  55. 55DGX Spark (GB10)AI mini PC · 128 GB~188 tok/s our est.Q4_K_M · 1.8 of 122 GB
  56. 56Ryzen AI Max+ 395 · 128 GBAI mini PC · 128 GB~183 tok/s ModelFit est.Q4_K_M · 1.8 of 96 GB
  57. 57Ryzen AI Max+ 395 · 64 GBAI mini PC · 64 GB~176 tok/s our est.Q4_K_M · 1.8 of 48 GB
  58. 58M4Mac · 16–32 GB · 3 variants~175 tok/s ModelFit est.Q4_K_M · 1.8 GB
  59. 59M3Mac · 8–24 GB · 3 variants~156 tok/s ModelFit est.Q4_K_M · 1.8 GB
  60. 60M2Mac · 8–24 GB · 3 variants~143 tok/s ModelFit est.Q4_K_M · 1.8 GB
  61. 61M1Mac · 8–16 GB · 2 variants~94 tok/s ModelFit est.Q4_K_M · 1.8 GB

Speeds are single-user decode estimates, not measurements. "ModelFit est." comes from ModelFit's model fitted on published runs (CC BY 4.0); "our est." is memory bandwidth divided by bytes read per token, times 0.55. Memory is what the best build needs, against what the machine can give a model. Method

About the model

Parameters
0.5B
Active per token
0.5B
Type
Dense
Good for
Chat, Mobile

Builds and how to run them

QuantizationLoadMin. RAMCommand
Q4_K_M0.8 GB2 GBollama run qwen2.5:0.5b-instruct-q4_K_M

Load, minimum RAM and Ollama commands: ModelFit, CC BY 4.0. Load is memory with the model loaded, before long contexts.

Questions

Can I run Qwen2.5 0.5B Instruct on a Mac?

Yes on a Mac with enough memory: the smallest Apple configuration listed here that runs it at 4-bit or better is the M3 · 8 GB.

How much memory does Qwen2.5 0.5B Instruct need?

About 1.8 GB at the smallest build in our data, including a margin for the runtime and an 8K-token context. Longer contexts need more.

Does Qwen2.5 0.5B Instruct run on a DGX Spark?

Yes, at Q4_K_M. The Spark has 128 GB of unified memory, about 121.6 GB usable.