#strix-halo
The latest AI and developer news about #strix-halo, with the original source and a short summary.
The latest AI and developer news about #strix-halo, with the original source and a short summary.
New Docker image bundles vLLM fork and ROCm 10.1 for Strix Halo, achieving 40-43 tok/s decode for Qwen3.8-Flash-Next.
The open-source plugin targets gfx1151 hardware to optimize MoE GEMMs and attention layers, reducing 256k prompt prefill time from over two hours to four minutes.
ROCm 7.13 nightly adds Strix Halo optimizations and open-sources ROCprof.
Luce DFlash/PFlash boosts LLM inference performance by up to more than 3x on the AMD Strix Halo iGPU.
A Strix Halo 128GB system ran Mistral Medium 128B at 1.57 tokens per second.
On AMD Strix Halo, Mistral Medium 3.5 took about 2 hours to process a 48k prompt.
Comparing Vulkan and ROCm on a Strix Halo 128GB machine showed the winner varying by model.