AI Briefing#slopcodebench
The latest AI and developer news about #slopcodebench, with the original source and a short summary.
The latest AI and developer news about #slopcodebench, with the original source and a short summary.
SlopCodeBench, a UW–Madison benchmark, tests 15 agents on evolving coding tasks and reports that structural erosion increased in 77% of runs.
GPT-6 Astra achieved the highest strict pass rate of 16.3% on SlopCodeBench, while higher effort settings like XHigh often increased costs without improving or even degrading strict pass rates.
The SlopCodeBench study found that code generated by AI agents has approximately twice the duplication and complexity of human code, with even the latest models achieving a 0% pass rate on strict tests.
SlopCodeBench benchmark results showed Opus 5 passing only 4 out of 17 checkpoints, revealing a lack of reliability in long-horizon coding.