#gair-nlp
The latest AI and developer news about #gair-nlp, with the original source and a short summary.
The latest AI and developer news about #gair-nlp, with the original source and a short summary.
Gair NLP announces 801-30B-A3B-Base, a 30B-A3B MoE model trained from scratch on 11.8T tokens using recursive self-improvement (RSI) in pre-training, which is set to be open-sourced soon.