#sycl
The latest AI and developer news about #sycl, with the original source and a short summary.
The latest AI and developer news about #sycl, with the original source and a short summary.
llama.cpp has improved speculative decoding speed by about 45% through a multi-column MMVQ port for Intel Arc GPUs.
On Intel B70, llama.cpp OpenVINO became faster than SYCL, but still lagged behind LLM-Scaler.
On Intel Arc B70, the SYCL backend recorded pp4096 301.39 t/s and tg512 24.62 t/s.
Shared real-world benchmarks and issues from running Qwen3.5-27B on the Arc B70.