The latest AI and developer news about #sparse-activation, with the original source and a short summary.
AI2 has unveiled EMO, a 1B active/14B total MoE model.