Hardware to run Mistral Large 3 675B-A41B (MoE)

Dec 2025. Mistral's first frontier-scale open MoE — 41B active / 675B total, Apache 2.0, 256 K ctx, native vision and function calling. Trained on 3000 H200s; ships at parity with leading instruction-tuned open MoEs.

Quantization Q2 Q2_K Q4 Q4_K_M Q5 Q5_K_M Q8 Q8_0

Availability ⚡ Only plug & play

Cheapest

4× Strix Halo cluster (512 GB unified)

AMD · rack of 4 mini-PCs, 10 GbE fabric

$11,500

tokens / secQ4

235B-MoE 24 t/s

671B-MoE 5.0 t/s

1T-MoE —

Memory512 GB · 384 usable

Bandwidth256 GB/s

Idle / Active32 W / 480 W

Sticker$11,500

Why: Lowest sticker that still fits Mistral Large 3 675B-A41B (MoE) ($12k USD).

Amazon (Strix Halo Mini PC)GMKtec EVO-X2Bosgame M5Framework

📺 Reviews on YouTube

▶ Kimi-K2 (1T) / GLM 4.7 (355B) on a 4-node Strix Halo cluster — 512 GB unified memory ▶ AMD Strix Halo / Ryzen AI Max+ 395 — honest review (single-node baseline)

Fastest

DGX B200 — 8× B200 server (1.44 TB HBM3e)

NVIDIA · 10U DGX server

$475,000

tokens / secQ4

235B-MoE 165 t/s

671B-MoE 105 t/s

1T-MoE 90 t/s

Memory1440 GB · 1404 usable

Bandwidth8000 GB/s

Idle / Active900 W / 10200 W

Sticker$475,000

Why: Highest measured tg/s — 95 t/s on Mistral Large 3 675B-A41B (MoE)-class models at Q4.

NVIDIA DGX B200SuperMicro HGX B200Lambda Labs

📺 Reviews on YouTube

▶ Inside a 1.44 TB HBM3e NVIDIA HGX B200 AI Server from ASRock Rack

All-rounder

8× RTX Pro 6000 Blackwell server (768 GB)

NVIDIA · 4U server (e.g. SuperMicro AS-4125GS-TNRT)

$78,000

tokens / secQ4

235B-MoE 220 t/s

671B-MoE 75 t/s

1T-MoE 40 t/s

Memory768 GB · 744 usable

Bandwidth1792 GB/s

Idle / Active220 W / 4800 W

Sticker$78,000

Why: Top quartile across speed, value, memory headroom, and efficiency — the "buy this if unsure" pick.

AmazonPNY ProCoreWeaveSuperMicro

Best value

12× RTX Pro 6000 Blackwell rack (1152 GB)

NVIDIA · 8U server rack (multi-node, 1-2 chassis)

$118,000

tokens / secQ4

235B-MoE 260 t/s

671B-MoE 95 t/s

1T-MoE 55 t/s

Memory1152 GB · 1116 usable

Bandwidth1792 GB/s

Idle / Active340 W / 7400 W

Sticker$118,000

Why: Best $/tg-per-second — ~$1,376 per t/s.

AmazonCoreWeaveSuperMicroSHI enterprise

Best CUDA

DGX H200 — 8× H200 server (1.13 TB HBM3e)

NVIDIA · 8U DGX / HGX server rack

$380,000

tokens / secQ4

235B-MoE 155 t/s

671B-MoE 100 t/s

1T-MoE 85 t/s

Memory1128 GB · 1100 usable

Bandwidth4800 GB/s

Idle / Active700 W / 6500 W

Sticker$380,000

Why: Strongest CUDA-only software stack among fitting builds.

NVIDIA DGX H200SuperMicro HGXLambda Labs

📺 Reviews on YouTube

▶ Inside the SUPER NVIDIA H200 Server From Supermicro (8U HGX H200)

Most VRAM

8× DGX Spark cluster (1024 GB unified, CUDA)

NVIDIA · rack of 8 desktops, 200 GbE fabric

$43,500

tokens / secQ4

235B-MoE 42 t/s

671B-MoE 16 t/s

1T-MoE 13 t/s

Memory1024 GB · 976 usable

Bandwidth273 GB/s

Idle / Active220 W / 1840 W

Sticker$43,500

Why: 976 GB usable — most headroom for batching and longer contexts.

Amazon (8× DGX Spark)Micro CenterNVIDIA MarketplaceServeTheHome guide

📺 Reviews on YouTube

▶ NVIDIA didn't want me to do this — 8× DGX Spark 1 TB VRAM cluster (AZisk) ▶ I built an 8x NVIDIA GB10 cluster for massive Local AI

Efficient

Mac Studio M3 Ultra 512 GB

Apple · small desktop

$14,199

tokens / secQ4

235B-MoE 22 t/s

671B-MoE 8.0 t/s

1T-MoE 6.0 t/s

Memory512 GB · 480 usable

Bandwidth819 GB/s

Idle / Active12 W / 220 W

Sticker$14,199

Why: 220 W active — lowest power draw of the fitting builds.

Apple RefurbB&H Photo (used)eBay (used)

📺 Reviews on YouTube

▶ M3 Ultra Mac Studio Review ▶ M3 Ultra vs RTX 5090 — The Final Battle

Cheapest

Mac Studio M3 Ultra 512 GB

Apple · small desktop

$14,199

tokens / secQ4

235B-MoE 22 t/s

671B-MoE 8.0 t/s

1T-MoE 6.0 t/s

Memory512 GB · 480 usable

Bandwidth819 GB/s

Idle / Active12 W / 220 W

Sticker$14,199

Why: Lowest sticker that still fits Mistral Large 3 675B-A41B (MoE) ($14k USD).

Apple RefurbB&H Photo (used)eBay (used)

📺 Reviews on YouTube

▶ M3 Ultra Mac Studio Review ▶ M3 Ultra vs RTX 5090 — The Final Battle

Every other build that runs Mistral Large 3 675B-A41B (MoE)

4 additional builds fit Mistral Large 3 675B-A41B (MoE) at Q4_K_M (380 GB usable minimum), sorted by sticker price.

Build	Price	Memory	Bandwidth	tg/s (Q4)	Active W	5-yr power
4× DGX Spark cluster (512 GB unified, CUDA)NVIDIA · rack of 4 desktops	$20k	512 / 488 GB	273 GB/s	9.9 t/s	920 W	$3.4k
8× Strix Halo cluster (1024 GB unified)AMD · rack of 8 mini-PCs, 10/25 GbE fabric	$23k	1024 / 768 GB	256 GB/s	7.2 t/s	960 W	$3.4k
2× Mac Studio M3 Ultra 512 GB cluster (TB5 / MLX)Apple · two desktops, Thunderbolt 5 RDMA	$28k	1024 / 960 GB	819 GB/s	8.1 t/s	440 W	$1.5k
8× H100 80 GB serverNVIDIA · server rack	$280k	640 / 620 GB	3350 GB/s	63 t/s	5600 W	$20k

Last updated 2026-07-11