AI Briefing#human-evaluation
The latest AI and developer news about #human-evaluation, with the original source and a short summary.
The latest AI and developer news about #human-evaluation, with the original source and a short summary.
The study evaluated LLMs against human annotators across 70 language pairs using MQM and ESA schemes, finding both unreliable in most settings.
Analysis of 21,000 conversations across 4 LLM models verified the appropriateness and controllability of human-like behaviors.
Checklists and critique decomposition pushed the LLM Judge's agreement rate with humans up to 84%.