AI Briefing#open-llm-leaderboard
The latest AI and developer news about #open-llm-leaderboard, with the original source and a short summary.
The latest AI and developer news about #open-llm-leaderboard, with the original source and a short summary.
Upstage's Solar has been integrated into Sendbird's no-code AI chatbot.
Upstage has released a free public beta of the Solar LLM API, offering translation and credit benefits.
Hugging Face resolved math evaluation errors on the Open LLM Leaderboard by introducing Math-Verify and recalculated the rankings.
Introduces the performance evaluation method and Model Merge technique of a model that achieved #1 on Hugging Face's Open LLM Leaderboard.
The abnormally low model scores observed on the DROP benchmark in the Open LLM Leaderboard were found to be caused by a normalization error in the evaluation metric.
This analyzes the technical causes behind the differences in MMLU benchmark scores between the Open LLM Leaderboard and model papers.
Upstage's LLM Solar has become the first domestic model to be registered as a main model on Quora's Poe.
Upstage took 2nd place among 30B models on the HuggingFace Open LLM Leaderboard.
Upstage's Solar 10.7B took first place on the Hugging Face Open LLM Leaderboard.