#gpu-performance
The latest AI and developer news about #gpu-performance, with the original source and a short summary.
The latest AI and developer news about #gpu-performance, with the original source and a short summary.
InfraRSI achieved a geometric mean speedup of 1.83x on H100/H200 by simultaneously exploring configurations and code.
The system uses high-fidelity production replay and parallel sub-agents to diagnose bottlenecks and test speculative decoding, quantization, and scheduling changes.
Maxwell, a Code Execution Model by doubleAI available in early access, rewrites binaries at runtime with formal proof of semantic equivalence, achieving 1.86x speedups in LTX-2.5 video generation.
The new GDN chunked kernel implementation in llama.cpp delivers performance gains ranging from 0.9% to 20.6% across various Qwen models and hardware configurations.
mistral.rs v0.8.2 has been released, delivering up to 2.8x faster CUDA inference performance than llama.cpp on the latest GPUs such as H100 and B200.