FitLocally by GPUwerk

Nemotron · 4B

Can you run NVIDIA Nemotron 3.5 Bolt E4B locally?

NVIDIA Nemotron 3.5 Bolt E4B is a 4B-parameter model. At 4-bit or better it runs on 112 of the 120 hardware configurations listed here; the smallest is the RTX 5070 (12 GB). On a 128 GB DGX Spark it runs at Q4_K_M.

Data as of 2 November 2026

Fastest machines for NVIDIA Nemotron 3.5 Bolt E4B

Every machine that runs it, fastest first. Filter by type; your machine is marked. Compare machines running it side by side

  1. 1RTX 5090Graphics card · 32 GB~267 tok/s ModelFit est.Q4_K_M · 9.1 of 31 GB
  2. 2RTX PRO 6000 BlackwellGraphics card · 96 GB~267 tok/s ModelFit est.Q4_K_M · 9.1 of 95 GB
  3. 32x RTX 5090Graphics card · 64 GB~248 tok/s ModelFit est.Q4_K_M · 9.1 of 62 GB
  4. 42x RTX PRO 6000 BlackwellGraphics card · 192 GB~248 tok/s ModelFit est.Q4_K_M · 9.1 of 190 GB
  5. 5RTX 4090Graphics card · 24 GB~173 tok/s ModelFit est.Q4_K_M · 9.1 of 23 GB
  6. 6RTX 5080Graphics card · 16 GB~172 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  7. 7M5 UltraMac · 96–512 GB · 5 variants~171 tok/s ModelFit est.Q4_K_M · 9.1 GB
  8. 82x RTX 4090Graphics card · 48 GB~165 tok/s ModelFit est.Q4_K_M · 9.1 of 46 GB
  9. 9RTX 5070 TiGraphics card · 16 GB~163 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  10. 10RTX 3090 TiGraphics card · 24 GB~161 tok/s ModelFit est.Q4_K_M · 9.1 of 23 GB
  11. 112x RTX 3090 TiGraphics card · 48 GB~154 tok/s ModelFit est.Q4_K_M · 9.1 of 46 GB
  12. 12RTX 3090Graphics card · 24 GB~152 tok/s ModelFit est.Q4_K_M · 9.1 of 23 GB
  13. 132x RTX 3090Graphics card · 48 GB~146 tok/s ModelFit est.Q4_K_M · 9.1 of 46 GB
  14. 14RTX 4080 SUPERGraphics card · 16 GB~135 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  15. 15RTX 4080Graphics card · 16 GB~132 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  16. 16RTX 5070Graphics card · 12 GB~130 tok/s ModelFit est.Q4_K_M · 9.1 of 11.0 GB
  17. 17RX 7900 XTXGraphics card · 24 GB~129 tok/s ModelFit est.Q4_K_M · 9.1 of 23 GB
  18. 18RTX 4070 Ti SUPERGraphics card · 16 GB~126 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  19. 192x RX 7900 XTXGraphics card · 48 GB~124 tok/s ModelFit est.Q4_K_M · 9.1 of 46 GB
  20. 20M3 UltraMac · 96–512 GB · 5 variants~120 tok/s ModelFit est.Q4_K_M · 9.1 GB
  21. 21RX 7900 XTGraphics card · 20 GB~115 tok/s ModelFit est.Q4_K_M · 9.1 of 19.0 GB
  22. 22M5 MaxMac · 48–128 GB · 3 variants~113 tok/s ModelFit est.Q4_K_M · 9.1 GB
  23. 23M2 UltraMac · 64–192 GB · 7 variants~106 tok/s ModelFit est.Q4_K_M · 9.1 GB
  24. 24RX 9070 XTGraphics card · 16 GB~100 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  25. 25RTX 4070 TiGraphics card · 12 GB~98 tok/s ModelFit est.Q4_K_M · 9.1 of 11.0 GB
  26. 26RTX 4070 SUPERGraphics card · 12 GB~98 tok/s ModelFit est.Q4_K_M · 9.1 of 11.0 GB
  27. 27RTX 4070Graphics card · 12 GB~98 tok/s ModelFit est.Q4_K_M · 9.1 of 11.0 GB
  28. 28M4 MaxMac · 48–128 GB · 3 variants~94 tok/s ModelFit est.Q4_K_M · 9.1 GB
  29. 29M1 UltraMac · 64–128 GB · 4 variants~94 tok/s ModelFit est.Q4_K_M · 9.1 GB
  30. 30RTX 5060 TiGraphics card · 16 GB~92 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  31. 31M5 Max · 36 GB · 32cMac · 36 GB~87 tok/s ModelFit est.Q4_K_M · 9.1 of 24 GB
  32. 32M3 MaxMac · 48–128 GB · 3 variants~74 tok/s ModelFit est.Q4_K_M · 9.1 GB
  33. 33M4 Max · 36 GB · 32cMac · 36 GB~73 tok/s ModelFit est.Q4_K_M · 9.1 of 24 GB
  34. 34M2 MaxMac · 32–96 GB · 5 variants~69 tok/s ModelFit est.Q4_K_M · 9.1 GB
  35. 35RTX 3060Graphics card · 12 GB~67 tok/s ModelFit est.Q4_K_M · 9.1 of 11.0 GB
  36. 36M5 ProMac · 24–64 GB · 6 variants~66 tok/s ModelFit est.Q4_K_M · 9.1 GB
  37. 37M1 MaxMac · 32–64 GB · 4 variants~62 tok/s ModelFit est.Q4_K_M · 9.1 GB
  38. 38RX 9060 XTGraphics card · 16 GB~60 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  39. 39RTX 4060 TiGraphics card · 16 GB~58 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  40. 40Tesla P100Graphics card · 16 GB~57 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  41. 41M3 MaxMac · 36–96 GB · 2 variants~57 tok/s ModelFit est.Q4_K_M · 9.1 GB
  42. 42M4 ProMac · 24–64 GB · 6 variants~55 tok/s ModelFit est.Q4_K_M · 9.1 GB
  43. 43Tesla T4Graphics card · 16 GB~51 tok/s ModelFit est.Q4_K_M · 9.1 of 15.0 GB
  44. 44Ryzen AI Max+ 395 · 128 GBAI mini PC · 128 GB~43 tok/s ModelFit est.Q4_K_M · 9.1 of 96 GB
  45. 45M2 ProMac · 16–32 GB · 2 variants~40 tok/s ModelFit est.Q4_K_M · 9.1 GB
  46. 46M6Mac · 24–32 GB · 3 variants~39 tok/s ModelFit est.Q4_K_M · 9.1 GB
  47. 47M1 ProMac · 16–32 GB · 2 variants~36 tok/s ModelFit est.Q4_K_M · 9.1 GB
  48. 48M6Mac · 16 GB · 2 variants~35 tok/s ModelFit est.Q4_K_M · 9.1 GB
  49. 49M5Mac · 16–32 GB · 6 variants~34 tok/s ModelFit est.Q4_K_M · 9.1 GB
  50. 50M3 ProMac · 18–36 GB · 2 variants~32 tok/s ModelFit est.Q4_K_M · 9.1 GB
  51. 51M4Mac · 16–32 GB · 3 variants~25 tok/s ModelFit est.Q4_K_M · 9.1 GB
  52. 52M3Mac · 16–24 GB · 2 variants~22 tok/s ModelFit est.Q4_K_M · 9.1 GB
  53. 53M2Mac · 16–24 GB · 2 variants~21 tok/s ModelFit est.Q4_K_M · 9.1 GB
  54. 54M1 · 16 GBMac · 16 GB~13 tok/s ModelFit est.Q4_K_M · 9.1 of 10.7 GB
  55. 55Ryzen AI Max+ 395 · 64 GBAI mini PC · 64 GBno estimateQ4_K_M · 9.1 of 48 GB
  56. 56DGX Spark (GB10)AI mini PC · 128 GBno estimateQ4_K_M · 9.1 of 122 GB
Too big for 8 machines

RTX 5060, RTX 4060, RTX 3070, RTX 3060 Ti, RTX 2070, M3 · 8 GB, M2 · 8 GB, M1 · 8 GB. NVIDIA Nemotron 3.5 Bolt E4B needs about 9.1 GB at its smallest build.

Speeds are single-user decode estimates, not measurements. "ModelFit est." comes from ModelFit's model fitted on published runs (CC BY 4.0); "our est." is memory bandwidth divided by bytes read per token, times 0.55. Memory is what the best build needs, against what the machine can give a model. Method

About the model

Parameters
4B
Active per token
not in our sources
Type
not in our sources
Good for
Voice assistants, Tool calling, Chat

Builds and how to run them

QuantizationLoadMin. RAMCommand
Q4_K_M7.9 GB12 GBollama run nemotron-3.5-bolt:e4b

Load, minimum RAM and Ollama commands: ModelFit, CC BY 4.0. Load is memory with the model loaded, before long contexts.

Questions

Can I run NVIDIA Nemotron 3.5 Bolt E4B on a Mac?

Yes on a Mac with enough memory: the smallest Apple configuration listed here that runs it at 4-bit or better is the M2 Pro · 16 GB.

How much memory does NVIDIA Nemotron 3.5 Bolt E4B need?

About 9.1 GB at the smallest build in our data, including a margin for the runtime and an 8K-token context. Longer contexts need more.

Does NVIDIA Nemotron 3.5 Bolt E4B run on a DGX Spark?

Yes, at Q4_K_M. The Spark has 128 GB of unified memory, about 121.6 GB usable.