GitHub Rewrites Copilot Runtime in Rust… Completing 800,000 Lines of Code in 14 Weeks

GitHub completely rewrote the Copilot runtime from TypeScript to Rust using the GitHub Copilot app and CLI. During this process, AI agents wrote most of the code, and a single developer completed the task in approximately 3 months (14.5 weeks). The existing architecture required hosting Node.js and V8, resulting in a minimum memory overhead of 100MB and inter-process communication costs. The migration to Rust eliminated these V8 dependencies and overheads, improving runtime performance by several orders of magnitude.

Migration Scale and Strategy

Instead of a 'big bang' approach, a progressive deployment strategy was adopted to ensure the main branch remained deployable at all times. Over 14.5 weeks, a total of 135 releases were conducted (100 pre-releases and 35 stable releases). As of August 21, 832,378 lines of production Rust code and 468,689 lines of unit tests were completed.

AI Utilization and Efficiency

Out of a total of 12,760,995 events, direct human input accounted for only about 2,600 instances. The prompt cache hit rate was 96.22%, ensuring the economic viability of long sessions. This was achieved by maintaining stable prefixes, such as system prompts and tool definitions, to minimize context reuse costs. Regression issues encountered during the migration were quickly identified and fixed, with future ownership and performance redesigns planned.