AI Briefing#leaderboard
The latest AI and developer news about #leaderboard, with the original source and a short summary.
The latest AI and developer news about #leaderboard, with the original source and a short summary.
VIDRAFT has released a leaderboard that grades operational forecasts daily and a fusion model on Hugging Face.
AutoJev-27B, d1-ultra, and decider-12b tie for the top spot with a score of 60 in the new benchmark for single-pass decision models.
Achieves 0.743 accuracy by performing decisions with a single forward pass of a 27B model
Out of 44 official leaderboards, there were 0 verified scores, and Chinese organizations accounted for 55.2% of submissions.
The new leaderboard uses objective metrics like WER and RTFx to evaluate open-source TTS models, reducing assessment time from weeks to hours.
An open-source embedding leaderboard has launched, enabling objective comparison of Korean RAG and retrieval performance.
GLM 5.2 officially ranked 3rd on the ProgramBench benchmark, which tests reconstructing source code from binary executables.
A public leaderboard has launched to compete on LoRA fine-tuning speed under identical hardware and dataset conditions.
Vercel has released AI Gateway leaderboard data under a CC BY 4.0 license.
Vercel has added data download and chart sharing features to the AI Gateway leaderboard, which is based on real production traffic data.
Hugging Face has released a leaderboard that compares agent systems' performance and cost together.
Hugging Face has revived the long-unmaintained PapersWithCode and launched a new site.
On the Arena leaderboard, Xiaomi's MIT-licensed model Mimo-v2.5 Pro surpassed Claude Opus 4.5.
In a benchmark of 42 documents and 7,560 calls, cheaper/older models outperformed on OCR performance and cost efficiency.
QIMMA first validates Arabic benchmarks before evaluating LLMs on them.
Hugging Face has launched a decentralized evaluation system that allows the community to directly submit and verify scores, aiming to increase transparency in model evaluation.
The Open Arabic LLM Leaderboard 2 has been released to transparently evaluate the performance of Arabic LLMs.
Hugging Face and LLM-jp collaborated to release an open leaderboard evaluating the performance of Japanese LLMs.
A new benchmark leaderboard has been released to evaluate the performance of LLMs specialized in the financial domain.
A leaderboard comparing the performance of image generation models based on over 45,000 human preferences has launched.
Patronus AI has launched a new LLM leaderboard that evaluates real-world enterprise use cases such as finance and law.
A new Safety Leaderboard based on DecodingTrust, which comprehensively evaluates LLMs' toxicity, bias, security, and more, has been released.
It introduces the technical method of building a custom LLM leaderboard using Hugging Face's new template, along with Vectara's case study.
Hugging Face released a leaderboard comparing the performance of object detection models and explained the key evaluation metrics.