Hardware to run Xiaomi MiMo V2.5 310B-A15B (MoE)
May 2026 release. 310 B / 15 B active omnimodal MoE — mid-tier sibling of MiMo V2.5-Pro. 256 experts top-8, 1 M context, MIT. Same Xiaomi MiMo family that reached ~13% of all OpenRouter token traffic by May 2026 (up from zero a year earlier).
Quantization
Availability
Cheapest
Quad AMD MI50 32 GB (128 GB) homelab build
AMD · rack/large tower
$2,500
tokens / secQ2
120B-MoE 54 t/s
235B-MoE —
671B-MoE —
Memory128 GB · 122 usable
Bandwidth1024 GB/s
Idle / Active75 W / 1200 W
Sticker$2,500
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($2.5k USD).
Fastest
12× RTX Pro 6000 Blackwell rack (1152 GB)
NVIDIA · 8U server rack (multi-node, 1-2 chassis)
$118,000
tokens / secQ2
120B-MoE —
235B-MoE 312 t/s
671B-MoE 114 t/s
Memory1152 GB · 1116 usable
Bandwidth1792 GB/s
Idle / Active340 W / 7400 W
Sticker$118,000
Why: Highest measured tg/s — 458 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q2.
All-rounder
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ2
120B-MoE 66 t/s
235B-MoE 26 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ2
120B-MoE 384 t/s
235B-MoE 156 t/s
671B-MoE 60 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Best $/tg-per-second — ~$122 per t/s.
Best CUDA
8× RTX Pro 6000 Blackwell server (768 GB)
NVIDIA · 4U server (e.g. SuperMicro AS-4125GS-TNRT)
$78,000
tokens / secQ2
120B-MoE —
235B-MoE 264 t/s
671B-MoE 90 t/s
Memory768 GB · 744 usable
Bandwidth1792 GB/s
Idle / Active220 W / 4800 W
Sticker$78,000
Why: Strongest CUDA-only software stack among fitting builds.
Most VRAM
DGX B200 — 8× B200 server (1.44 TB HBM3e)
NVIDIA · 10U DGX server
$475,000
tokens / secQ2
120B-MoE 396 t/s
235B-MoE 198 t/s
671B-MoE 126 t/s
Memory1440 GB · 1404 usable
Bandwidth8000 GB/s
Idle / Active900 W / 10200 W
Sticker$475,000
Why: 1404 GB usable — most headroom for batching and longer contexts.
📺 Reviews on YouTube
Efficient
MacBook Pro M5 Max 128 GB
Apple · laptop
$5,399
tokens / secQ2
120B-MoE 78 t/s
235B-MoE —
671B-MoE —
Memory128 GB · 108 usable
Bandwidth614 GB/s
Idle / Active6 W / 95 W
Sticker$5,399
Why: 95 W active — lowest power draw of the fitting builds.
Cheapest
ASUS Ascent GX10 (128 GB)
ASUS · small desktop
$3,977
tokens / secQ2
120B-MoE 61 t/s
235B-MoE —
671B-MoE —
Memory128 GB · 119 usable
Bandwidth273 GB/s
Idle / Active35 W / 240 W
Sticker$3,977
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($4.0k USD).
Fastest
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ2
120B-MoE 384 t/s
235B-MoE 156 t/s
671B-MoE 60 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Highest measured tg/s — 229 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q2.
All-rounder
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ2
120B-MoE 66 t/s
235B-MoE 26 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Single AMD Instinct MI325X 256 GB workstation
AMD · workstation / 4U server (OAM)
$25,000
tokens / secQ2
120B-MoE 312 t/s
235B-MoE 126 t/s
671B-MoE 34 t/s
Memory256 GB · 250 usable
Bandwidth6000 GB/s
Idle / Active100 W / 1000 W
Sticker$25,000
Why: Best $/tg-per-second — ~$135 per t/s.
📺 Reviews on YouTube
Best CUDA
Dual RTX Pro 6000 Blackwell build
NVIDIA · workstation
$24,400
tokens / secQ2
120B-MoE —
235B-MoE 108 t/s
671B-MoE —
Memory192 GB · 188 usable
Bandwidth1792 GB/s
Idle / Active50 W / 1100 W
Sticker$24,400
Why: Strongest CUDA-only software stack among fitting builds.
Most VRAM
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ2
120B-MoE 66 t/s
235B-MoE 26 t/s
671B-MoE 9.6 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: 480 GB usable — most headroom for batching and longer contexts.
📺 Reviews on YouTube
Efficient
MacBook Pro M5 Max 128 GB
Apple · laptop
$5,399
tokens / secQ2
120B-MoE 78 t/s
235B-MoE —
671B-MoE —
Memory128 GB · 108 usable
Bandwidth614 GB/s
Idle / Active6 W / 95 W
Sticker$5,399
Why: 95 W active — lowest power draw of the fitting builds.
Every other build that runs Xiaomi MiMo V2.5 310B-A15B (MoE)
25 additional builds fit Xiaomi MiMo V2.5 310B-A15B (MoE) at Q2_K (105 GB usable minimum), sorted by sticker price.
| Build | Price | Memory | Bandwidth | tg/s (Q2) | Active W | 5-yr power |
|---|---|---|---|---|---|---|
Dell Pro Max with GB10 (128 GB)Dell · small desktop | $4.1k | 128 / 119 GB | 273 GB/s | — | 240 W | $887 |
Lenovo ThinkStation PGX (128 GB)Lenovo · small desktop | $4.1k | 128 / 119 GB | 273 GB/s | — | 160 W | $650 |
MSI EdgeXpert MS-C931 (128 GB)MSI · small desktop | $4.7k | 128 / 119 GB | 273 GB/s | — | 240 W | $887 |
Mac Studio M4 Max 128 GBApple · small desktop | $4.7k | 128 / 112 GB | 546 GB/s | — | 130 W | $453 |
NVIDIA DGX Spark (128 GB)NVIDIA · small desktop | $4.7k | 128 / 119 GB | 273 GB/s | — | 240 W | $887 |
Quad Intel Arc Pro B70 buildIntel · rack/large tower | $6k | 128 / 124 GB | 608 GB/s | — | 700 W | $2.5k |
2× Strix Halo cluster (256 GB unified)AMD · mini-PC pair | $7k | 256 / 192 GB | 256 GB/s | 32 t/s | 240 W | $841 |
2× DGX Spark cluster (256 GB unified, CUDA)NVIDIA · two desktops, 200 G interconnect | $10k | 256 / 240 GB | 273 GB/s | 41 t/s | 460 W | $1.7k |
Octuple Intel Arc Pro B70 clusterIntel · rack/large tower | $11k | 256 / 248 GB | 608 GB/s | 62 t/s | 1450 W | $5k |
4× Strix Halo cluster (512 GB unified)AMD · rack of 4 mini-PCs, 10 GbE fabric | $14k | 512 / 384 GB | 256 GB/s | 42 t/s | 480 W | $1.7k |
Tinybox Red (6× 7900 XTX, 144 GB)tinycorp · 12U pedestal | $15k | 144 / 138 GB | 960 GB/s | — | 1500 W | $5k |
4× DGX Spark cluster (512 GB unified, CUDA)NVIDIA · rack of 4 desktops | $20k | 512 / 488 GB | 273 GB/s | 47 t/s | 920 W | $3.4k |
Tinybox Green (6× RTX 4090, 144 GB)tinycorp · 12U pedestal | $25k | 144 / 138 GB | 1008 GB/s | 106 t/s | 2200 W | $8k |
8× Strix Halo cluster (1024 GB unified)AMD · rack of 8 mini-PCs, 10/25 GbE fabric | $27k | 1024 / 768 GB | 256 GB/s | 56 t/s | 960 W | $3.4k |
2× Mac Studio M3 Ultra 512 GB cluster (TB5 / MLX)Apple · two desktops, Thunderbolt 5 RDMA | $28k | 1024 / 960 GB | 819 GB/s | 60 t/s | 440 W | $1.5k |
Single AMD Instinct MI300X 192 GB workstationAMD · workstation | $30k | 192 / 188 GB | 5300 GB/s | 141 t/s | 750 W | $2.8k |
Quad RTX Pro 6000 Blackwell build (384 GB)NVIDIA · workstation / 4U pedestal | $38k | 384 / 372 GB | 1792 GB/s | 255 t/s | 2200 W | $8k |
Single H200 141 GB workstationNVIDIA · workstation / 2U server | $40k | 141 / 138 GB | 4800 GB/s | 97 t/s | 700 W | $2.5k |
Tinybox Pro (8× RTX 4090, 192 GB)tinycorp · 12U pedestal | $40k | 192 / 184 GB | 1008 GB/s | 141 t/s | 3200 W | $11k |
8× DGX Spark cluster (1024 GB unified, CUDA)NVIDIA · rack of 8 desktops, 200 GbE fabric | $44k | 1024 / 976 GB | 273 GB/s | 74 t/s | 1840 W | $7k |
Tinybox Green v2 (4× RTX 5090, 128 GB)tinycorp · 12U pedestal | $45k | 128 / 124 GB | 1792 GB/s | 123 t/s | 2300 W | $8k |
Single B200 180 GB workstationNVIDIA · workstation / 4U server | $47k | 180 / 176 GB | 8000 GB/s | 106 t/s | 1000 W | $3.6k |
8× H100 80 GB serverNVIDIA · server rack | $280k | 640 / 620 GB | 3350 GB/s | 194 t/s | 5600 W | $20k |
DGX H200 — 8× H200 server (1.13 TB HBM3e)NVIDIA · 8U DGX / HGX server rack | $380k | 1128 / 1100 GB | 4800 GB/s | 273 t/s | 6500 W | $24k |
NVIDIA RTX Spark (128 GB)NVIDIA · OEM laptops + small desktops | — | 128 / 119 GB | 300 GB/s | — | — W | $756 |
Cheapest
2× Strix Halo cluster (256 GB unified)
AMD · mini-PC pair
$6,600
tokens / secQ4
120B-MoE 40 t/s
235B-MoE 18 t/s
671B-MoE —
Memory256 GB · 192 usable
Bandwidth256 GB/s
Idle / Active16 W / 240 W
Sticker$6,600
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($7k USD).
Fastest
12× RTX Pro 6000 Blackwell rack (1152 GB)
NVIDIA · 8U server rack (multi-node, 1-2 chassis)
$118,000
tokens / secQ4
120B-MoE —
235B-MoE 260 t/s
671B-MoE 95 t/s
Memory1152 GB · 1116 usable
Bandwidth1792 GB/s
Idle / Active340 W / 7400 W
Sticker$118,000
Why: Highest measured tg/s — 381 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q4.
All-rounder
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ4
120B-MoE 55 t/s
235B-MoE 22 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ4
120B-MoE 320 t/s
235B-MoE 130 t/s
671B-MoE 50 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Best $/tg-per-second — ~$147 per t/s.
Best CUDA
8× RTX Pro 6000 Blackwell server (768 GB)
NVIDIA · 4U server (e.g. SuperMicro AS-4125GS-TNRT)
$78,000
tokens / secQ4
120B-MoE —
235B-MoE 220 t/s
671B-MoE 75 t/s
Memory768 GB · 744 usable
Bandwidth1792 GB/s
Idle / Active220 W / 4800 W
Sticker$78,000
Why: Strongest CUDA-only software stack among fitting builds.
Most VRAM
DGX B200 — 8× B200 server (1.44 TB HBM3e)
NVIDIA · 10U DGX server
$475,000
tokens / secQ4
120B-MoE 330 t/s
235B-MoE 165 t/s
671B-MoE 105 t/s
Memory1440 GB · 1404 usable
Bandwidth8000 GB/s
Idle / Active900 W / 10200 W
Sticker$475,000
Why: 1404 GB usable — most headroom for batching and longer contexts.
📺 Reviews on YouTube
Efficient
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ4
120B-MoE 55 t/s
235B-MoE 22 t/s
671B-MoE 8.0 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: 220 W active — lowest power draw of the fitting builds.
📺 Reviews on YouTube
Cheapest
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ4
120B-MoE 55 t/s
235B-MoE 22 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($8k USD).
📺 Reviews on YouTube
Fastest
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ4
120B-MoE 320 t/s
235B-MoE 130 t/s
671B-MoE 50 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Highest measured tg/s — 191 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q4.
All-rounder
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ4
120B-MoE 55 t/s
235B-MoE 22 t/s
671B-MoE 8.0 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Single AMD Instinct MI325X 256 GB workstation
AMD · workstation / 4U server (OAM)
$25,000
tokens / secQ4
120B-MoE 260 t/s
235B-MoE 105 t/s
671B-MoE 28 t/s
Memory256 GB · 250 usable
Bandwidth6000 GB/s
Idle / Active100 W / 1000 W
Sticker$25,000
Why: Best $/tg-per-second — ~$162 per t/s.
📺 Reviews on YouTube
Every other build that runs Xiaomi MiMo V2.5 310B-A15B (MoE)
10 additional builds fit Xiaomi MiMo V2.5 310B-A15B (MoE) at Q4_K_M (190 GB usable minimum), sorted by sticker price.
| Build | Price | Memory | Bandwidth | tg/s (Q4) | Active W | 5-yr power |
|---|---|---|---|---|---|---|
2× DGX Spark cluster (256 GB unified, CUDA)NVIDIA · two desktops, 200 G interconnect | $10k | 256 / 240 GB | 273 GB/s | 34 t/s | 460 W | $1.7k |
Octuple Intel Arc Pro B70 clusterIntel · rack/large tower | $11k | 256 / 248 GB | 608 GB/s | 51 t/s | 1450 W | $5k |
4× Strix Halo cluster (512 GB unified)AMD · rack of 4 mini-PCs, 10 GbE fabric | $14k | 512 / 384 GB | 256 GB/s | 35 t/s | 480 W | $1.7k |
4× DGX Spark cluster (512 GB unified, CUDA)NVIDIA · rack of 4 desktops | $20k | 512 / 488 GB | 273 GB/s | 39 t/s | 920 W | $3.4k |
8× Strix Halo cluster (1024 GB unified)AMD · rack of 8 mini-PCs, 10/25 GbE fabric | $27k | 1024 / 768 GB | 256 GB/s | 47 t/s | 960 W | $3.4k |
2× Mac Studio M3 Ultra 512 GB cluster (TB5 / MLX)Apple · two desktops, Thunderbolt 5 RDMA | $28k | 1024 / 960 GB | 819 GB/s | 50 t/s | 440 W | $1.5k |
Quad RTX Pro 6000 Blackwell build (384 GB)NVIDIA · workstation / 4U pedestal | $38k | 384 / 372 GB | 1792 GB/s | 213 t/s | 2200 W | $8k |
8× DGX Spark cluster (1024 GB unified, CUDA)NVIDIA · rack of 8 desktops, 200 GbE fabric | $44k | 1024 / 976 GB | 273 GB/s | 62 t/s | 1840 W | $7k |
8× H100 80 GB serverNVIDIA · server rack | $280k | 640 / 620 GB | 3350 GB/s | 161 t/s | 5600 W | $20k |
DGX H200 — 8× H200 server (1.13 TB HBM3e)NVIDIA · 8U DGX / HGX server rack | $380k | 1128 / 1100 GB | 4800 GB/s | 227 t/s | 6500 W | $24k |
Cheapest
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ5
120B-MoE 46 t/s
235B-MoE 18 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($8k USD).
📺 Reviews on YouTube
Fastest
12× RTX Pro 6000 Blackwell rack (1152 GB)
NVIDIA · 8U server rack (multi-node, 1-2 chassis)
$118,000
tokens / secQ5
120B-MoE —
235B-MoE 218 t/s
671B-MoE 80 t/s
Memory1152 GB · 1116 usable
Bandwidth1792 GB/s
Idle / Active340 W / 7400 W
Sticker$118,000
Why: Highest measured tg/s — 320 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q5.
All-rounder
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ5
120B-MoE 269 t/s
235B-MoE 109 t/s
671B-MoE 42 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
Best value
Single AMD Instinct MI325X 256 GB workstation
AMD · workstation / 4U server (OAM)
$25,000
tokens / secQ5
120B-MoE 218 t/s
235B-MoE 88 t/s
671B-MoE 24 t/s
Memory256 GB · 250 usable
Bandwidth6000 GB/s
Idle / Active100 W / 1000 W
Sticker$25,000
Why: Best $/tg-per-second — ~$193 per t/s.
📺 Reviews on YouTube
Best CUDA
8× RTX Pro 6000 Blackwell server (768 GB)
NVIDIA · 4U server (e.g. SuperMicro AS-4125GS-TNRT)
$78,000
tokens / secQ5
120B-MoE —
235B-MoE 185 t/s
671B-MoE 63 t/s
Memory768 GB · 744 usable
Bandwidth1792 GB/s
Idle / Active220 W / 4800 W
Sticker$78,000
Why: Strongest CUDA-only software stack among fitting builds.
Most VRAM
DGX B200 — 8× B200 server (1.44 TB HBM3e)
NVIDIA · 10U DGX server
$475,000
tokens / secQ5
120B-MoE 277 t/s
235B-MoE 139 t/s
671B-MoE 88 t/s
Memory1440 GB · 1404 usable
Bandwidth8000 GB/s
Idle / Active900 W / 10200 W
Sticker$475,000
Why: 1404 GB usable — most headroom for batching and longer contexts.
📺 Reviews on YouTube
Efficient
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ5
120B-MoE 46 t/s
235B-MoE 18 t/s
671B-MoE 6.7 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: 220 W active — lowest power draw of the fitting builds.
📺 Reviews on YouTube
Cheapest
Mac Studio M3 Ultra 256 GB
Apple · small desktop
$7,999
tokens / secQ5
120B-MoE 46 t/s
235B-MoE 18 t/s
671B-MoE —
Memory256 GB · 232 usable
Bandwidth819 GB/s
Idle / Active10 W / 180 W
Sticker$7,999
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($8k USD).
📺 Reviews on YouTube
Fastest
Single AMD Instinct MI355X 288 GB workstation
AMD · 4U server (OAM, liquid-cooled)
$28,000
tokens / secQ5
120B-MoE 269 t/s
235B-MoE 109 t/s
671B-MoE 42 t/s
Memory288 GB · 282 usable
Bandwidth8000 GB/s
Idle / Active140 W / 1400 W
Sticker$28,000
Why: Highest measured tg/s — 160 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q5.
All-rounder
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ5
120B-MoE 46 t/s
235B-MoE 18 t/s
671B-MoE 6.7 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Single AMD Instinct MI325X 256 GB workstation
AMD · workstation / 4U server (OAM)
$25,000
tokens / secQ5
120B-MoE 218 t/s
235B-MoE 88 t/s
671B-MoE 24 t/s
Memory256 GB · 250 usable
Bandwidth6000 GB/s
Idle / Active100 W / 1000 W
Sticker$25,000
Why: Best $/tg-per-second — ~$193 per t/s.
📺 Reviews on YouTube
Every other build that runs Xiaomi MiMo V2.5 310B-A15B (MoE)
10 additional builds fit Xiaomi MiMo V2.5 310B-A15B (MoE) at Q5_K_M (226 GB usable minimum), sorted by sticker price.
| Build | Price | Memory | Bandwidth | tg/s (Q5) | Active W | 5-yr power |
|---|---|---|---|---|---|---|
2× DGX Spark cluster (256 GB unified, CUDA)NVIDIA · two desktops, 200 G interconnect | $10k | 256 / 240 GB | 273 GB/s | 29 t/s | 460 W | $1.7k |
Octuple Intel Arc Pro B70 clusterIntel · rack/large tower | $11k | 256 / 248 GB | 608 GB/s | 43 t/s | 1450 W | $5k |
4× Strix Halo cluster (512 GB unified)AMD · rack of 4 mini-PCs, 10 GbE fabric | $14k | 512 / 384 GB | 256 GB/s | 30 t/s | 480 W | $1.7k |
4× DGX Spark cluster (512 GB unified, CUDA)NVIDIA · rack of 4 desktops | $20k | 512 / 488 GB | 273 GB/s | 33 t/s | 920 W | $3.4k |
8× Strix Halo cluster (1024 GB unified)AMD · rack of 8 mini-PCs, 10/25 GbE fabric | $27k | 1024 / 768 GB | 256 GB/s | 39 t/s | 960 W | $3.4k |
2× Mac Studio M3 Ultra 512 GB cluster (TB5 / MLX)Apple · two desktops, Thunderbolt 5 RDMA | $28k | 1024 / 960 GB | 819 GB/s | 42 t/s | 440 W | $1.5k |
Quad RTX Pro 6000 Blackwell build (384 GB)NVIDIA · workstation / 4U pedestal | $38k | 384 / 372 GB | 1792 GB/s | 179 t/s | 2200 W | $8k |
8× DGX Spark cluster (1024 GB unified, CUDA)NVIDIA · rack of 8 desktops, 200 GbE fabric | $44k | 1024 / 976 GB | 273 GB/s | 52 t/s | 1840 W | $7k |
8× H100 80 GB serverNVIDIA · server rack | $280k | 640 / 620 GB | 3350 GB/s | 136 t/s | 5600 W | $20k |
DGX H200 — 8× H200 server (1.13 TB HBM3e)NVIDIA · 8U DGX / HGX server rack | $380k | 1128 / 1100 GB | 4800 GB/s | 191 t/s | 6500 W | $24k |
Cheapest
4× Strix Halo cluster (512 GB unified)
AMD · rack of 4 mini-PCs, 10 GbE fabric
$13,500
tokens / secQ8
120B-MoE 29 t/s
235B-MoE 12 t/s
671B-MoE 2.6 t/s
Memory512 GB · 384 usable
Bandwidth256 GB/s
Idle / Active32 W / 480 W
Sticker$13,500
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($14k USD).
Fastest
12× RTX Pro 6000 Blackwell rack (1152 GB)
NVIDIA · 8U server rack (multi-node, 1-2 chassis)
$118,000
tokens / secQ8
120B-MoE —
235B-MoE 135 t/s
671B-MoE 49 t/s
Memory1152 GB · 1116 usable
Bandwidth1792 GB/s
Idle / Active340 W / 7400 W
Sticker$118,000
Why: Highest measured tg/s — 198 t/s on Xiaomi MiMo V2.5 310B-A15B (MoE)-class models at Q8.
All-rounder
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ8
120B-MoE 29 t/s
235B-MoE 11 t/s
671B-MoE 4.2 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.
📺 Reviews on YouTube
Best value
Quad RTX Pro 6000 Blackwell build (384 GB)
NVIDIA · workstation / 4U pedestal
$38,000
tokens / secQ8
120B-MoE —
235B-MoE 75 t/s
671B-MoE 21 t/s
Memory384 GB · 372 usable
Bandwidth1792 GB/s
Idle / Active100 W / 2200 W
Sticker$38,000
Why: Best $/tg-per-second — ~$344 per t/s.
Best CUDA
8× RTX Pro 6000 Blackwell server (768 GB)
NVIDIA · 4U server (e.g. SuperMicro AS-4125GS-TNRT)
$78,000
tokens / secQ8
120B-MoE —
235B-MoE 114 t/s
671B-MoE 39 t/s
Memory768 GB · 744 usable
Bandwidth1792 GB/s
Idle / Active220 W / 4800 W
Sticker$78,000
Why: Strongest CUDA-only software stack among fitting builds.
Most VRAM
DGX B200 — 8× B200 server (1.44 TB HBM3e)
NVIDIA · 10U DGX server
$475,000
tokens / secQ8
120B-MoE 172 t/s
235B-MoE 86 t/s
671B-MoE 55 t/s
Memory1440 GB · 1404 usable
Bandwidth8000 GB/s
Idle / Active900 W / 10200 W
Sticker$475,000
Why: 1404 GB usable — most headroom for batching and longer contexts.
📺 Reviews on YouTube
Efficient
2× Mac Studio M3 Ultra 512 GB cluster (TB5 / MLX)
Apple · two desktops, Thunderbolt 5 RDMA
$28,400
tokens / secQ8
120B-MoE 37 t/s
235B-MoE 15 t/s
671B-MoE 4.7 t/s
Memory1024 GB · 960 usable
Bandwidth819 GB/s
Idle / Active24 W / 440 W
Sticker$28,400
Why: 440 W active — lowest power draw of the fitting builds.
Cheapest
Mac Studio M3 Ultra 512 GB
Apple · small desktop
$14,199
tokens / secQ8
120B-MoE 29 t/s
235B-MoE 11 t/s
671B-MoE 4.2 t/s
Memory512 GB · 480 usable
Bandwidth819 GB/s
Idle / Active12 W / 220 W
Sticker$14,199
Why: Lowest sticker that still fits Xiaomi MiMo V2.5 310B-A15B (MoE) ($14k USD).
📺 Reviews on YouTube
Every other build that runs Xiaomi MiMo V2.5 310B-A15B (MoE)
5 additional builds fit Xiaomi MiMo V2.5 310B-A15B (MoE) at Q8_0 (365 GB usable minimum), sorted by sticker price.
| Build | Price | Memory | Bandwidth | tg/s (Q8) | Active W | 5-yr power |
|---|---|---|---|---|---|---|
4× DGX Spark cluster (512 GB unified, CUDA)NVIDIA · rack of 4 desktops | $20k | 512 / 488 GB | 273 GB/s | 20 t/s | 920 W | $3.4k |
8× Strix Halo cluster (1024 GB unified)AMD · rack of 8 mini-PCs, 10/25 GbE fabric | $27k | 1024 / 768 GB | 256 GB/s | 24 t/s | 960 W | $3.4k |
8× DGX Spark cluster (1024 GB unified, CUDA)NVIDIA · rack of 8 desktops, 200 GbE fabric | $44k | 1024 / 976 GB | 273 GB/s | 32 t/s | 1840 W | $7k |
8× H100 80 GB serverNVIDIA · server rack | $280k | 640 / 620 GB | 3350 GB/s | 84 t/s | 5600 W | $20k |
DGX H200 — 8× H200 server (1.13 TB HBM3e)NVIDIA · 8U DGX / HGX server rack | $380k | 1128 / 1100 GB | 4800 GB/s | 118 t/s | 6500 W | $24k |
Sources
Last updated 2026-07-11