AI Briefing#kernel-optimization
The latest AI and developer news about #kernel-optimization, with the original source and a short summary.
The latest AI and developer news about #kernel-optimization, with the original source and a short summary.
PyTorch's Helion now uses compile-time heuristics to select fast kernel configurations without autotuning, achieving 1.18x speedup over Flash Linear Attention and 1.88x over torch.compile for matmuls on H100.
TVM and Together Compiler demonstrate that stable IRs and verification tools are necessary to constrain search costs and ensure correctness when AI agents optimize inference kernels.
The GLM-5.3-based Infra Agent built GLM-5.3-Flash inference infrastructure on a cluster of over 100,000 Chinese accelerators in less than two weeks, boosting end-to-end serving performance by approximately 3x.
Naver Cloud optimized the Mamba-2 kernel for B200 GPUs using Helion DSL, increasing single-layer computation speed by 1.33x.
vLLM resolved the non-deterministic output issue for Qwen3.8-Flash-Next at temperature 0 by fixing the sparse-attention kernel.
AWS optimizes AI models and kernels alongside chip design to strengthen Trainium's competitiveness.
Qwen3.7-Max has unveiled its agentic, coding, and long-horizon autonomous execution performance.
A hackathon was held where participants use OpenAI Codex to optimize Mac Metal kernels.
Cursor's multi-agent system made 235 CUDA kernels 38% faster in just 3 weeks.
KernelEvolve automatically optimizes AI kernel performance by exploring hundreds of candidates.
Hugging Face and AMD collaborated to release custom kernels specifically for MI300X that maximize the performance of Llama 3.1 405B.