AI mini PCs

Which AI models run on the DGX Spark (GB10, 128 GB)?

The DGX Spark (GB10, 128 GB) has 128 GB of memory, about 122 GB of it usable for a model, and 273 GB/s of memory bandwidth. 103 of the 110 models in our catalog run on it at 4-bit or better.

Sold as: NVIDIA DGX Spark, ASUS Ascent GX10, Dell Pro Max with GB10, Lenovo ThinkStation PGX, MSI EdgeXpert, HP ZGX Nano G1n, Acer Veriton GN100, Gigabyte AI TOP ATOM

Data as of 2 November 2026 · Vendor specs

Compare with other machines
128 GBmemory ~122 GB usable for a model
273 GB/sbandwidth, sets the speed
103models run at 4-bit or better

Also covers other GB10 systems with 128 GB (ASUS Ascent GX10, Dell Pro Max GB10, Lenovo ThinkStation PGX, MSI EdgeXpert). Usable figure: addressable unified memory.

Our pick for this machine Qwen3.8-Flash-Next Q4_K_XL · 115 of 122 GB · ~28 tok/s our est. The largest model on our shortlist of current models that runs at 4-bit or better and 10 tok/s or more.

Models that run on it

ModelBest buildMemorySpeed
Qwen3.8-Flash-Next125B MoEQ4_K_XL115 GB~28 tok/s our est.
Nemotron 3 Super 120B-A12B120B MoEQ4_K_M90 GB~23 tok/s reported
Nemotron 3.5 Super VL 120B-A12B120B MoEQ6_K102 GB~15 tok/s our est.
gpt-oss-120b117B MoEMXFP468 GB~61 tok/s reported
Llama 3.3 70B70.6BQ4_K_M44 GB~6.0 tok/s slow measured
Llama 3.3 Nemotron Super 49B49BQ4_K_M31 GB~5.1 tok/s slow our est.
Qwen3.6-35B-A3B35B MoEQ8_041 GB~45 tok/s our est.
Gemma 4 31B30.7BQ4_K_M21 GB~7.5 tok/s slow our est.
Qwen3-Coder-30B-A3B30.5B MoEQ8_034 GB~43 tok/s our est.
Nemotron 3 Nano 30B-A3B30B MoEFP1662 GB~25 tok/s our est.
Qwen3.8-27B27.3BQ4_K_M17.9 GB~11 tok/s reported
Gemma 4 26B-A4B25.2B MoEQ8_030 GB~52 tok/s reported
gpt-oss-20b21B MoEMXFP415.1 GB~63 tok/s our est.
Nemotron Nano 9B v29BQ8_010.8 GB~16 tok/s our est.
Qwen3.5 9B Instruct9BQ8_012.0 GB~14 tok/s our est.
Qwen2.5 7B Instruct7BQ4_K_M6.6 GB~27 tok/s our est.
Gemma 3 4B Instruct4BQ8_05.0 GB~39 tok/s our est.
Ornith 1.5 122B125.09BQ4_K_M79 GBno estimate
Ling-3.0-flash124BIQ4_XS71 GBno estimate
Devstral 2 123B123BQ4_K_M78 GBno estimate
Qwen3.5 122B-A10B Instruct122B MoEQ4_K_M75 GB~25 tok/s our est.
Laguna S 2.1118BQ4_K_M99 GBno estimate
Llama 4 Scout109B MoEQ4_K_M70 GB~14 tok/s our est.
Qwen3-Next 80B-A3B80B MoEQ8_088 GB~47 tok/s our est.
Kolibri 178.1BIQ4_XS46 GBno estimate
Llama 3.1 70B Instruct70BQ4_K_M44 GB~3.6 tok/s slow our est.
DeepSeek-R1 Distill Llama 70B70BQ4_K_M44 GB~3.6 tok/s slow our est.
Mixtral 8x7B Instruct46.7B MoEQ4_K_M32 GB~18 tok/s our est.
Flint 40B-A2.5B39.8B MoENVFP424 GB~104 tok/s our est.
Sage-A1.535.95BQ4_K_M23 GBno estimate
Qwen3.5 35B-A3B Instruct35B MoEQ8_041 GB~45 tok/s our est.
Ornith 1.0 35B35BQ4_K_M23 GBno estimate
Nanbeige4.3 33B33.1BQ4_K_M22 GBno estimate
Poolside Laguna XS.233BQ4_K_M25 GBno estimate
Laguna XS 2.133BQ4_K_M22 GBno estimate
Qwen3 32B32BQ4_K_M22 GB~7.4 tok/s slow our est.
DeepSeek-R1 Distill Qwen 32B32BQ4_K_M21 GB~7.5 tok/s slow our est.
Olmo 3.1 32B Instruct32BQ4_K_M21 GBno estimate
Qwen3 30B30BQ4_K_M24 GB~6.8 tok/s slow our est.
NVIDIA Nemotron Cascade 2 30B-A3B30B MoEQ6_K26 GB~63 tok/s our est.
Cohere North Mini Code30BQ4_K_M20 GBno estimate
Nemotron 3.5 Lightning 30B-A3B30B MoEQ4_K_M27 GB~59 tok/s our est.
GLM-4.7-Flash 30B-A3B30B MoEQ4_K_M20 GB~79 tok/s our est.
Granite Switch 4.1 30B30BQ4_K_M23 GBno estimate
Muse Glimmer 30B29.8BQ4_K_M18.3 GBno estimate
Granite 4.2 30B29.3BQ4_K_M17.9 GBno estimate
AREX-2 27B27.4BQ4_K_M18.6 GBno estimate
Gemma 2 27B Instruct27BQ4_K_M23 GB~7.2 tok/s slow our est.
Gemma 3 27B Instruct27BQ4_K_M23 GB~7.2 tok/s slow our est.
Qwen3.5 27B Instruct27BQ4_K_M17.4 GB~9.4 tok/s slow our est.
Qwen3.6 27B27BQ4_K_M19.4 GB~8.3 tok/s slow our est.
Jebadiah 27B27BQ4_K_M18.2 GBno estimate
Mistral Small 3.124BQ4_K_M16.4 GB~10 tok/s our est.
LFM2 24B-A2B Instruct24B MoEQ4_K_M15.3 GB~129 tok/s our est.
Devstral Small 2 24B24BQ4_K_M16.6 GBno estimate
Mistral Small 22B22BQ4_K_M18.4 GB~8.8 tok/s slow our est.
Qwen2.5 14B Instruct14BQ4_K_M12.3 GB~14 tok/s our est.
Phi-3 Medium 14B14BQ4_K_M12.3 GB~14 tok/s our est.
Phi-4 14B14BQ8_015.9 GB~10 tok/s our est.
Qwen2.5 Coder 14B14BQ4_K_M12.3 GB~14 tok/s our est.
Qwen3 14B14BQ4_K_M12.3 GB~14 tok/s our est.
DeepSeek-R1 Distill Qwen 14B14BQ8_016.0 GB~10 tok/s our est.
Ministral 3 14B13.5BQ4_K_M10.3 GBno estimate
Mellum2.1 12B-A2.5B Thinking12.1B MoEQ4_K_M9.3 GB~90 tok/s our est.
Mistral Nemo 12B12BQ4_K_M10.7 GBno estimate
Gemma 3 12B Instruct12BQ4_K_M10.7 GB~16 tok/s our est.
Gemma 4 12B12BQ8_014.1 GB~12 tok/s our est.
GLM-4-9B-Chat9.4BQ4_K_M7.5 GBno estimate
Gemma 2 9B Instruct9BQ4_K_M8.2 GB~21 tok/s our est.
Ornith 1.0 9B9BQ4_K_M6.7 GBno estimate
MiMo-V2.6-Distill-Qwen-9B9BQ4_K_M6.9 GBno estimate
Jebadiah 9B9BQ4_K_M6.9 GBno estimate
Granite 4.2 8B8.8BQ4_K_M6.1 GBno estimate
Granite Switch 4.1 8B8.8BQ4_K_M7.6 GBno estimate
MiniCPM-V 4.5 8B8.7BQ4_K_M6.8 GBno estimate
Ministral 3 8B8.4BQ4_K_M7.1 GBno estimate
LFM2.5 8B-A1B8.3B MoEQ4_K_M6.6 GB~227 tok/s our est.
Llama 3.1 8B Instruct8BQ8_09.2 GB~19 tok/s our est.
Qwen3 8B8BQ8_09.3 GB~19 tok/s our est.
Granite 4.1 8B Instruct8BQ4_K_M6.6 GBno estimate
Mistral 7B Instruct7BQ8_08.4 GB~21 tok/s our est.
Qwen2.5 Coder 7B7BQ4_K_M6.6 GB~27 tok/s our est.
DeepSeek-R1 Distill Qwen 7B7BQ8_08.7 GB~20 tok/s our est.
Gemma 4 E4B4.5BQ4_K_M5.1 GBno estimate
Qwen3.5 4B Instruct4BQ8_05.4 GB~35 tok/s our est.
NVIDIA Nemotron 3.5 Bolt E4B4BQ4_K_M9.1 GBno estimate
Phi-3 Mini 3.8B3.8BQ4_K_M4.3 GB~47 tok/s our est.
Phi-4 Mini 3.8B3.8BQ8_04.9 GB~40 tok/s our est.
Granite 4.2 3B3.7BQ4_K_M3.2 GBno estimate
Ministral 3 3B3.4BQ4_K_M4.1 GBno estimate
Qwen2.5 3B Instruct3BQ4_K_M3.6 GB~60 tok/s our est.
Llama 3.2 3B Instruct3BQ4_K_M3.6 GB~60 tok/s our est.
Granite 4.1 3B Instruct3BQ4_K_M3.0 GBno estimate
Gemma 4 E2B2.3BQ4_K_M3.4 GBno estimate
Gemma 2 2B Instruct2BQ4_K_M2.8 GB~83 tok/s our est.
Qwen3.5 2B Instruct2BQ4_K_M2.8 GB~83 tok/s our est.
LFM3 1.7B1.73BQ4_K_M2.1 GBno estimate
Qwen2.5 1.5B Instruct1.5BQ4_K_M2.5 GB~100 tok/s our est.
Llama 3.2 1B Instruct1BQ4_K_M2.0 GB~150 tok/s our est.
Gemma 3 1B Instruct1BQ8_02.0 GB~150 tok/s our est.
Qwen3.5 0.8B Instruct0.8BQ4_K_M1.8 GB~188 tok/s our est.
Qwen2.5 0.5B Instruct0.5BQ4_K_M1.8 GB~188 tok/s our est.
SmolLM2 360M0.36BQ4_K_M1.5 GBno estimate

ModelFit does not cover this machine, so speeds come from our bandwidth formula; measured figures are on each model page where we have them. Method

Fits only at 3-bit or lower

DeepSeek-V4-Flash.

Too big for this machine

Qwen3-235B-A22B (134 GB), GLM-5.3-Flash (200 GB), Llama 3.1 405B Instruct (250 GB), Llama 4 Maverick (252 GB), Ling-3.1-flash-1019 (368 GB), DeepSeek-R1 671B (390 GB).

Questions

What is the best AI model for the DGX Spark (GB10, 128 GB)?

Qwen3.8-Flash-Next at Q4_K_XL: the largest model on our shortlist of current models that runs at 4-bit or better at a usable speed (about 28 tok/s, our est.).

How much memory can a model use on the DGX Spark (GB10, 128 GB)?

About 122 GB of the 128 GB. Also covers other GB10 systems with 128 GB (ASUS Ascent GX10, Dell Pro Max GB10, Lenovo ThinkStation PGX, MSI EdgeXpert). Usable figure: addressable unified memory.

How fast is the DGX Spark (GB10, 128 GB) for local LLMs?

Decode speed is limited by memory bandwidth: 273 GB/s. A model that reads 10 GB per token runs at under 27 tokens per second.