#hybrid-model
The latest AI and developer news about #hybrid-model, with the original source and a short summary.
The latest AI and developer news about #hybrid-model, with the original source and a short summary.
In hybrid model serving, it increased prefill TPM by up to 3.14x and reduced p90 TTFT by up to 88%.
Olmo Hybrid model demonstrated superiority over Transformer in semantic token prediction.
LiquidAI has released LFM2.5-8B-A1B, a hybrid model designed for on-device deployment.
Mistral Small 4 has been released as a 119B MoE, 256k multimodal reasoning model.
TurboQuant fixed a speculative decoding bug in its Qwen3.6 fork.
Kakao developed Kanana-v-4b-hybrid, a hybrid multimodal language model that generates answers through a thinking process.
By leveraging high-quality reasoning data, a 15B reasoning model was distilled into a 2.1x faster Mamba hybrid without performance degradation.
IBM and researchers from major universities have unveiled Bamba-9B, a hybrid Mamba2 model that maximizes inference efficiency.