#kernel-fusion

The latest AI and developer news about #kernel-fusion, with the original source and a short summary.

New Kernel Fusion Techniques Hide Up to 90% of Normalization Latency in GEMM and Attention Kernels

New kernel fusion techniques for LayerNorm and RMSNorm hide up to 90% of normalization latency in GEMM kernels and achieve up to 35% speedup in attention kernels on NVIDIA B200 GPUs.

·2026.11.14 21:00

Optimizing PyTorch with Fused MLP

Using PyTorch Profiler to analyze the overhead occurring in MLP structures and explaining an optimization method through Fused MLP.

·2·2026.06.12 09:00

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA, a GPU kernel abstraction that solves the memory bottleneck in Transformer training, has been released

·1·2026.05.22 13:00