#gpu-kernels
The latest AI and developer news about #gpu-kernels, with the original source and a short summary.
The latest AI and developer news about #gpu-kernels, with the original source and a short summary.
The Tang project uses an IR-based compiler to derive GPU kernels, achieving 5-12% faster decode steps for 80B MoE models at high concurrency and reducing 44k-token prefill time by a third on H200 GPUs.
Moondream 3.1 is now available through Prime Inference, powered by the Photon engine which delivers over 60 inferences per second on a single H100.