AI Briefing#801-30b-a3b-base
The latest AI and developer news about #801-30b-a3b-base, with the original source and a short summary.
The latest AI and developer news about #801-30b-a3b-base, with the original source and a short summary.
Gair NLP announces 801-30B-A3B-Base, a 30B-A3B MoE model trained from scratch on 11.8T tokens using recursive self-improvement (RSI) in pre-training, which is set to be open-sourced soon.