AI Briefing
KOSign in

modern-web-guidance boosts coding agent pass rates by up to 36pp with modern web primitives

·2026.11.11 03:01

Key point

A joint project by Google, Microsoft, Mozilla, and MDN embeds curated web standards into AI agents, raising pass rates from 52-60% to 82-96% in evaluations.

Details

  • modern-web-guidance is a set of skills stewarded by Google Chrome, Microsoft Edge, Mozilla Firefox, and MDN teams to counter legacy JavaScript bias in LLM training data.
  • Evaluations conducted between November 2-8, 2024 show significant performance gains: antigravity_cli (gemini-4-argon) improved from 58-60% to 94-96% (+36pp), codex_cli (gpt-6.1-sol) from 52-55% to 82-86% (+27-33pp), and claude_code (opus-5-5) from 56-57% to 88-90% (+31-34pp).
  • The tool includes 74 JavaScript & API features and 203 real-world use cases, using zero-dependency embedding models and BM25 for local semantic search without API keys.
  • Safety gates prevent agents from adopting Origin Trial APIs or volatile features (released in the last 3 months) without explicit developer opt-in via .mwgrc configuration.
  • The tool is used by coding agents such as Grok Build CLI, and evaluations were performed on agents including antigravity_cli, codex_cli, and claude_code.
web-developmentopen-sourcellm-evaluationai-coding-toolsbrowser-apis
Read originalShare on Threads

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.

Related

Redditbasal-omni-2.0-mini released with 0.811 Werdykt score and two-way state readingRedditKittenML Releases Kitten TTS 2 Mini, Nano, and Pico Models for CPU InferencePyTorchKRllama.cpp v1.0.0, First Major Release in Three and a Half YearsGeekNewsGitHub Next releases Ace, a local collaborative coding environment for humans and AI agentsCloudflare BlogCloudflare open-sources Kitesurf, its stateless browser for AI agentsHacker NewsGnomon: Git-like version control for Postgres data built for AI agents