Local AI
Hardware guides, model analysis, benchmarks, and practical local-first AI infrastructure.
A comparison of WRX80, TRX40, and AMD EPYC motherboards for multi-GPU local AI builds, with UK marketplace prices, PCIe lanes, memory bandwidth, Threadripper Pro CCD layouts, remote management, and the risks of importing used server hardware.
How DeepSeek V4 Flash cuts inference cost with sparse experts, compressed attention, FP4/FP8 weights, disk-backed prefix caching and speculative decoding, plus API cost estimates and real local benchmarks on RTX PRO 6000, DGX Spark and Apple Silicon.
A concise guide to the M3 Ultra Mac Studio, M4 Max Mac Studio, and M5 Max MacBook Pro for local LLMs, including real benchmarks, current and used pricing, MLX and Metal software, Thunderbolt clustering, and an estimate for a possible M5 Ultra.
A practical guide to NVIDIA DGX Spark and other GB10 systems for local LLMs, covering real token speeds, memory bandwidth, MoE models, clustering, thermals, software support, pricing, Strix Halo, and Mac Studio alternatives.
A concise guide to AMD Strix Halo for local LLMs, covering real token speeds, memory bandwidth, MoE models, ROCm and Vulkan support, clustering, and the 192 GB Gorgon Halo refresh.
A comparison of GPUs, workstation cards, unified-memory devices, and CPU inference setups for local AI, focused on price, speed, memory capacity, software support, and practical tradeoffs.
A practical look at the RTX 3090 for local AI workloads, covering specs, VRAM, bandwidth, TFLOPS, used pricing, power limiting, LLM performance, image generation, and why it remains one of the best-value GPUs for running open models at home.