#kanana-moe
The latest AI and developer news about #kanana-moe, with the original source and a short summary.
The latest AI and developer news about #kanana-moe, with the original source and a short summary.
Kakao has open-sourced 'Kanana-1.5-15.7B-A3B', a model utilizing an MoE structure to achieve performance comparable to Dense 8B models with only 3B active parameters.