AI Briefing#mamba-2
The latest AI and developer news about #mamba-2, with the original source and a short summary.
The latest AI and developer news about #mamba-2, with the original source and a short summary.
cuTile kernels that boost Mamba-2 forward propagation speed by up to 1.82x on B300 GPUs have been released.
The open-weight reasoning model features 30B parameters with 3B active per token and a 1M token context window.
The method reduces pretraining costs by over 99% and enables controlled comparisons of hybrid architectures like Gated KalmaNet, Gated DeltaNet, and Mamba-2.
Naver Cloud optimized the Mamba-2 kernel for B200 GPUs using Helion DSL, increasing single-layer computation speed by 1.33x.
Soofi S, a highly efficient hybrid Mamba-MoE open-source model specialized for German and English, has been released.
Since Mamba, hybrid LLMs have been replacing the limits of Transformers.
The Falcon-H1 model series, featuring a hybrid architecture combining Transformer and SSM, has been released.
IBM and researchers from major universities have unveiled Bamba-9B, a hybrid Mamba2 model that maximizes inference efficiency.